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ABSTRACT 


For  interconnecting  a  large  number  of  functional  units  in  a 
multiple-processor  system,  the  multistage  interconnection  networks 
are  favorably  reviewed  in  comparison  with  the  interconnection 
organizations  of  time-shared/common  buses,  crossbar  switches,  and 
multiport  memory  schemes.  Previous  works  on  tVie  design  of  multi¬ 
stage  interconnection  networks  are  generally  related  to  the  network 
topology  or  the  implementable  permutation  functions.  The  influence 
of  communication  protocols  which  should,  nevertheless,  be  implemented 
for  the  intercommunication  function  of  the  interconnection  network 
is  usually  neglected.  In  addition,  this  field  is  still  lacking  a 
set  of  performance  standard  and  evaluation  tools  which  can  be  employed 
to  observe  the  tradeoffs  among  various  parameters.  Besides  these 
problems,  the  fault  diagnosis  scheme  for  the  interconnection  networks, 
which  is  important  for  a  reliable  or  fault  tolerant  systems,  has  not 
been  developed,  and  the  multiple-pass  realization  of  an  interconnec¬ 
tion  network  and  related  routing  algorithms  have  only  been  discussed 
for  a  single  stage  network.  The  problem  concerning  the  cost-effective 
LSI  implementation  of  the  interconnection  networks  also  remains 
unanswered.  This  stud}'  offers  relevant  solutions  to  these  problems. 

We  begin  our  study  by  surveying  the  multiple-processor  inter¬ 
connections.  In  this  survey  we  first  discuss  the  limitations  of  the 
conventional  interconnection  organizations  and  then  review  particular 
multistage  interconnection  networks  which  were  proposed  from  signifi¬ 
cantly  different  viewpoints.  A  wide  variety  of  switching  concepts 
and  parameters,  which  a  designer  may  have  to  encounter  in  planning 
and  designing  an  interconnection  network,  is  also  summarized.  In 
addition,  we  provide  a  set  of  characteristics  of  interconnection 
networks,  which  can  be  used  to  specify  the  performance  standard. 

We  also  describe  the  requirements  of  hardware  facilities  and  commu¬ 
nication  protocols  for  cost-effective  implementations  of  intercon¬ 
nection  networks. 


A  class  of  ir  ltistage  interconnection  networks  is  defined  by 
introducing  a  baseline  network  and  a  condition  of  topological  equiv¬ 
alence,  and  proving  that  the  condition  holds  for  every  network  so 
far  proposed.  The  class  of  topologically  equivalent  multistage 
interconnection  networks  includes  the  regular  SW  banyan  network  with 
S=F=2,  the  indirect  binary  n-cube  network,  the  modified  data  manip¬ 
ulator,  the  flip  network,  the  omega  network,  the  baseline  network, 
and  the  reverse  baseline  network.  A  logical  name  representation 
scheme  is  developed  to  configure  this  class  of  networks.  Using 
this  configuration,  we  propose  a  complete  and  homogeneous  routing 
procedure  which  includes  capabilities  of  resolving  conflicts  and 
allowing  connections  between  all  pairs  of  terminals.  The  routing 
can  be  done  in  both  ways  (from  side  1  to  side  2,  or  vice  versa)  in 
contrast  to  the  previously  proposed  one  which  can  only  be  done  in  a 
specific  direction.  Our  routing  procedure  implicitly  provides  a 
■  ting  protocol  for  the  packet  switching  communication. 

We  present  a  fault  diagnosis  scheme  for  the  class  of  multistage 
networks  by  proposing  a  general  fault  model  and  generating  a  test 
set  for  the  fault  model.  Specific  steps  for  diagnosing  single 
faults  and  detecting  multiple  faults  in  the  interconnection  network 
such  as  the  flip  network  and  the  indirect  binary  n-cube  network  are 
developed.  This  study  provides  specific  information  of  fault 
characteristics  for  designing  an  easily  diagnosable  network. 

The  class  of  multistage  interconnection  networks  with  the  con¬ 
figuration  is  introduced  as  a  reverse-exchange  interconnection  network 
which  is  shown  to  be  a  powerful  interconnection  network  for  the 
.  allel  processing  system.  A  recursive  formula  is  derived  to 
calculate  the  control  pattern  of  the  network  for  each  of  four 
realizable  permutation  classes.  The  recursive  formulas  can  provide 
superior  operating  speed  over  the  existing  routing  algorithms.  It 
is  proven  that  all  permutations  can  be  realized  by  the  reverse- 
<  ;change  network  in  two  passes.  Both  the  construction  and  routing 
algorithms  are  provided.  Our  result  compares  favorably  with  those 
of  other  networks. 

We  then  describe  a  logic  partitioning  scheme  to  implement  the 
class  of  multistage  interconnection  networks  optimally  in  the  sense 
of  using  LSI  circuit  chips  of  one  type  and  resulting  in  the  maximum 
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switching  element-to-pin  ratio.  The  scheme  extends  the  switch 
design  from  size  2  *  2  to  size  2a  x  2°,  thus  facilitating  cost- 
effective  LSI  implementation,  improving  the  reliability  of  switching 
elements  and  formulating  another  level  of  problems  for  research. 

Some  future  needs  and  a  set  of  possible  extensions  related  to 
this  study  are  also  discussed.  A  case  study  for  implementing  part 
of  the  design  philosophy  we  just  exposed  is  provided  in  the  Appendix. 
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evaluation 


Large  Scale  Integration  is  causing  revolutionary  changes.  It  is  now 
economically  feasible  to  construct  processing  systems  by  interconnecting 
large  numbers  of  low  cost  off-the-shelf  processors  and  memory  modules. 
Physical  limits  and  economics  are  providing  strong  bias  for  utilizing 
a  multiplicity  of  these  modules  to  attain  processing  power  through 
parallelism  and  reliability  through  redundancy.  To  accommodate  this 
trend,  particular  focus  must  be  placed  on  multi-module  interconnection 
strategies.  Conventional  interconnection  organizations  such  as 
time-shared/common  buses,  crossbar  switches  and  multiport  memory 
schemes  have  their  limitations  and  are  not  quite  suitable  for  systems 
involving  a  large  number  of  components. 

This  report  addresses  the  whole  class  of  multi-stage  interconnection 
networks.  A  formal  addressing  scheme  is  developed  to  facilitate  a 
homogeneous  routing  procedure.  Fault  diagnosis  schemes  are  developed. 
Finally,  consideration  is  given  to  partitioning  a  multi-stage  intercon¬ 
nection  network  for  practical  LSI  implementation.  This  partitioning  mini¬ 
mizes  the  number  of  chips  and  maximizes  the  gate  to  pin  ratio. 

The  multi-stage  interconnection  network  provides  a  basis  for 
exploiting  low-cost  mainstream  LSI  technology  to  provide  wide  ranges 
of  computing  power  by  economically  configuring  collections  of  standard 
modules.  In  addition  to  providing  a  framework  for  fault  tolerance  and 
modular  system  growth,  it  is  expected  that  software  for  these  systems 
will  be  somewhat  less  complex.  As  such,  TPO  thrusts  3D  and  5A  are 
directly  affected.  The  multi-stage  interconnection  network  is  being 
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CHAPTER  1 


INTRODUCTION 


1. 1  Definition  of  a  Multiple-Processor  System 

Various  multiple-processor  systems  have  been  proposed  and  con¬ 
structed  [1].  The  specific  examples  include  four  organizations 
(associative,  parallel,  pipeline,  and  multi-processors).  Although 
these  four  classes  of  organizations  are  a  subset  of  multiple- 
processor  systems,  there  is  no  existing  definition  which  can  con¬ 
clusively  characterize  every  attribute  in  the  subset.  In  the  fol¬ 
lowing  we  first  discuss  some  existing  definitions  of  computer  systems, 
then  offer  our  definition  of  the  multiple-processor  system: 

A.  Instruction  and  Data  Streams 

Flynn  [2]  proposed  in  1966  a  classification  scheme  based 
on  the  instruction  streams  and  data  streams.  There  are  four 
categoiies  in  the  scheme  (SISD,  SIMD,  MISD,  and  MIMD) .  Many 
contemporary  computer  systems  can  be  classified  in  terms  of 
these  four  categories. 

B.  Von  Neumann  Architecture 

The  vast  majority  of  computers  are  based  on  von  Neumann's 
architecture  [3].  The  architecture  includes  four  principal 
units  —  the  control  unit,  the  memory,  the  arithmetic-logic 
unit,  and  the  input/output  unit  (Fig.  1.1).  It  is  a  single 
processor  system  with  the  capability  of  sequential  execution, 
known  as  an  SISD  machine.  As  a  result  of  technology  changes, 
the  central  processing  unit  in  the  von  Neumann  architecture  has 
evolved  to  multiple-execution-unit  organization  such  as  CDC  6600. 

C.  Parallel  Processing  Systems 

The  multiple-execution-unit  organization  provides  some 
concurrent  activities  and  sometimes  is  considered  to  be  one  form 
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Fig.  1.1  Von  Neumann  organization 


Fig.  1.2  A  parallel  processor  system 
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of  parallel  processing.  In  general,  a  parallel  processing 
system  consists  of  a  number  of  arithmetic-logic  units  (known  as 
processing  elements)  and  memory  modules  as  shown  in  Fig.  1.2. 

In  most  cases,  a  parallel  processor  system  requires  inter¬ 
processor/memory  communications  to  improve  its  capability  and 
performance . 

Feng  [4]  classified  associative/parallel  processing  systems 
according  to  the  word  length,  i.e.  ,  the  number  of  bits  which  are 
processed  in  parallel  in  a  word  and  the  number  of  words  which 
are  processed  in  parallel.  A  computer  structure  is  represented 
by  a  point  in  a  plan  where  the  abscissa  is  the  word  length  and 
the  ordinate  is  the  number  of  words  processed  in  parallel.  The 
parallel  processors  include  two  types:  homogeneous  and  heterogeneous. 

D.  Multiprocessor  Systems 

Enslow  [5]  suggested  a  definition  for  the  multiprocessor 
system  as  being  a  subclass  of  M1MD  systems  in  which  the  proces¬ 
sors  have  the  common  access  to  their  primary  memory  as  well  as 
input-output  channels,  and  there  is  a  single  operating  system 
controlling  the  entire  complex.  Baer  [6]  used  two  features  to 
differentiate  MIMD  architecture  —  the  coupling  or  switching  of 
processor  units  and  memories,  and  the  homogeneity  of  the  process¬ 
ing  units.  He  discussed  tightly  coupled  and  loosely  coupled 
multiprocessors  of  homogeneous  and  heterogeneous  types.  The 
CDC  6600  is  thus  an  example  of  tightly  coupled  heterogeneous 
multiprocessor  systems  under  this  classification. 


E.  Computer  Networks 

A  computer  network  is  considered  to  be  any  interconnection 
of  an  assembly  of  computer  systems  and/or  terminals  together 
with  communications  facilities  [7].  Such  a  network  permits 
geographical  distribution  of  computer  operation,  parallel  pro¬ 
cessing,  and  various  resource  sharing.  The  basic  attributes  of 
a  network  that  distinguishes  its  architecture  includes  its 
topology  or  overall  organization,  composition,  size,  channel 
type  and  utilization  strategy,  and  control  mechanism. 


F.  Distributed  Processing  Systems 

Enslow  [8]  defined  an  allowable  region  for  distributed 
data  processing  systems  in  the  decentralization  space  formed 
by  hardware,  control  and  data  base.  In  general,  the  multiple 
processors  and  computers  with  cooperating  control  and  partitioned 
data  base  are  distributed  data  processing  systems. 

The  characteristics  and  classifications  of  machines  described 
above  may  be  used  to  define  the  multiple-processor  systems  as 
follows:  a  multiple-processor  system  contains  two  or  more  func¬ 
tional  modules  which  can  be  homogeneous  or  heterogeneous;  and 
the  functional  modules  are  interconnected  to  achieve  various 
levels  of  capabilities  (at  least  as  those  stated  previously 
[2-8]). 


1. 2  Objective  of  Investigation 

Recent  advances  in  LSI  technology  hdve  caused  significant  changes. 
It  is  now  economically  feasible  to  construct  a  processing  system  by 
interconnecting  a  large  number  of  off-the-shelf  processor  and  memory 
modules.  The  architectural  trend  [9-11]  is  thus  to  use  a  plurality 
of  processors  interconnected  together  to  gain  increased  operating 
power  through  parallelism  and  to  improve  system  reliability  through 
redundancy.  On  the  basis  of  the  past  progress  in  integrated-circuit 
technology,  it  is  projected  that  the  most  complex  computer  system  of 
today  can  be  fabricated  on  a  small  number  of  chips  within  the  next 
few  years  [12].  This  LSI  technology  project  suggests  that  complex 
dynamic  modules  of  processor-memory-switch  (PMS)  group  can  be  made 
available  for  constructing  the  multiple-processor  system  in  the  same 
way  as  the  architectural  trend  predicts. 

The  number  of  dynamic  modules  (homogeneous  or  heterogeneous)  in 
the  multiple-processor  system  would  keep  increasing  because  of  several 
reasons.  First,  the  processing  speed  in  the  future  can  be  signifi¬ 
cantly  increased  only  by  increasing  the  degree  of  the  concurrent 
processing  as  the  switching  speeds  of  computer  devices  approach  a 
limit.  Furthermore,  there  are  certain  classes  of  problems,  such  as 
large  data  base  management  systems,  weather  computations,  etc., 
which  are  beyond  the  capabilities  of  the  current  large  computers. 
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Thirdly,  the  low  cost  of  LSI  modules  allows  the  use  of  a  large  number 
of  functional  units.  However,  coordinating  a  large  number  of  PMS 
groups  into  an  efficient  functional  system  is  a  difficult  yet 
important  problem.  The  conventional  interconnection  organizations 
such  as  time-shared /common  busses,  crossbar  switches,  and  multiport 
memory  schemes  have  their  limitations  and  are  not  quite  suitable  for 
systems  involving  a  large  number  of  components  (modules) .  The  objec¬ 
tive  of  this  study  is  to  investigate  the  interconnection  problems  by 
using  some  multistage  interconnection  networks  upon  which  the 
multiple- processor  system  can  be  modelled  as  shown  in  Fig.  1.3  where 
the  PMS  box  could  represent  any  combination  of  processors,  memory 
modules  and  switches. 

Chapter  2  reviews  the  multiple-processor  interconnection  organi¬ 
zations  in  general,  and  the  multistage  interconnection  networks  in 
particular.  Some  communication  issues  of  multistage  interconnection 
networks  are  also  discussed  in  terms  of  hardware  and  software  require¬ 
ments.  Chapter  3  defines  a  class  of  multistage  interconnection 
networks  by  showing  the  isomorphic  topology.  A  formal  addressing 
scheme  is  developed  to  facilitate  a  homogeneous  routing  procedure. 

In  Chapter  4,  we  develop  a  fault-diagnosis  scheme  for  the  class  of 
multistage  interconnection  networks.  Both  single  faults  and  multiple 
faults  are  considered.  In  Chapter  5,  we  introduce  a  reverse-exchange 
interconnection  network  which  is  a  consequence  of  the  addressing 
scheme  developed  in  Chapter  3.  Both  the  realizable  permutation 
classes  and  the  related  control  patterns  are  developed.  Chapter  6 
shows  a  logic  partitioning  of  multistage  interconnection  networks 
for  LSI  implementation.  The  partitioning  is  made  in  the  sense  of 
minimizing  the  number  of  chip  types  and  maximizing  the  gate-to-pin 
ratio.  After  providing  the  conclusion  in  Chapter  7,  we  present  a 
case  study  —  a  microprocessor-controlled  asynchronous  circuit 
switching  network  in  the  Appendix. 


CHAPTER  2 


A  SURVEY  OF  MULTIPLE-PROCESSOR  INTERCOMMUNICATIONS 

As  a  result  of  increasing  the  number  of  functional  modules  in 
the  multiple-processor  system,  the  intercommunications  among  the 
functional  modules  become  increasingly  complex  and  inevitably  neces¬ 
sary.  Interconnection  networks  have  been  investigated  to  implement 
the  intercommunications.  However,  general  design  guidelines  a. id 
practical  issues  such  as  communication  protocols,  dynamic  reconfigura¬ 
tions,  etc.  are  usually  neglected.  In  addition,  this  field  is  still 
lacking  a  set  of  performance  standards  and  evaluation  tools  for 
designing  an  efficient  interconnection  network.  This  chapter  pro¬ 
vides  a  survey  on  the  intercommunication  issues  with  emphasis  on  these 
future  needs.  Section  2.1  reviews  the  interconnection  organizations 
of  multiple-processor  systems  to  emphasize  again  the  importance  of 
multistage  interconnection  networks.  Section  2.2  surveys  particular 
multistage  interconnection  networks  which  were  proposed  from  signi¬ 
ficantly  different  viewpoints.  In  Section  2.3,  we  catalogue  a  wide 
variety  of  switching  concepts  and  parameters  which  a  designer  may 
have  to  encounter  in  planning  and  designing  an  interconnection  network. 
Section  2.4  provides  a  set  of  characteristics  of  interconnection  net¬ 
works,  which  can  be  used  to  specify  the  performance  standard.  In 
Section  2.5,  we  describe  some  hardware  and  software  requirements  for 
implementing  functions  of  interconnection  networks. 

2. 1  Classification  of  Multiple-Processor  Interconnection  Organizations 

The  intercommunication  subsystem  is  a  key  to  the  classification  of 
computer  systems  [9,13,14],  The  scope  of  intercommunication  schemes 
can  be  viewed  in  several  levels  [15].  In  this  section  we  will  empha¬ 
size  the  interconnection  organizations  in  order  to  characterize  the 
system  architecture.  The  interconnection  organizations  of  present 
day  multiple-processor  systems  can  be  classified  into  several  categories 
as  follows: 
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A.  Time-Shared  or  Common  Buses: 


There  are  several  degrees  of  complexity  in  this  organization 
depending  on  the  number  and  the  functional  usage  of  buses.  The 
simplest  one  is  a  common  communication  bus  connecting  all  pro¬ 
cessors,  memories  and  input-output  units.  The  bus  can  be  totally 
passive  and  transfer  operations  are  controlled  completely  by  the 
bus  interfaces  of  the  sending  and  receiving  units.  It  is  possible 
to  simplify  the  transfer  process  by  the  use  of  a  centralized  bus 
arbiter.  The  cost  required  to  add  or  remove  functional  units  to 
the  bus  is  quite  low.  Usually  all  that  is  required  is,  within 
a  limit,  to  physically  attach  or  detach  the  unit.  The  location 
to  add  a  unit  is  also  flexible.  The  single  bus  introduces  a 
critical  system  component  which  can  cause  a  system  failure  as  a 
result  of  a  malfunction  in  any  circuit  component  of  the  bus 
subsystem.  There  is  also  a  serious  bottleneck  on  overall  system 
performance  because  only  one  path  can  be  established  at  any  time 
for  data  transfers. 

To  obtain  more  reliability  and  parallelism,  one  can  use 
multiple  buses,  either  uni-  or  bi-directional.  The  intercommu¬ 
nication  functions  may  be  partitioned  and  a  separate  bus  is  used 
for  each  functional  partition.  On  the  other  hand  multiple  and 
redundant  buses  may  be  used  for  system  reliability.  The  use  of 
multiple  buses  also  allows  multiple  simultaneous  transfers  (Fig.  6.2). 
However,  any  benefit  derived  from  the  multiple-bus  schemes  is 
at  the  expense  of  complex  bus  controls.  Some  degrees  of  control 
logic  such  as  arbitor  or  multiplexor  would  have  to  be  added. 

Some  examples  of  systems  employing  the  simple  time-shared 
bus  technique  include  PDP-11,  Lockheed  Sue,  and  CDC  6600  (for 
transfers  between  main  memory  and  peripheral  processors).  An 
example  for  functionally  partitioned  and  redundant  multiple  buses 
is  proposed  by  GTE  Sylvania  Inc.  [16]  for  communication  applica¬ 
tions.  Another  example  for  multiple  buses  is  the  Plessy  System 
250  [13]. 

B.  Crossbar  Switch: 


The  crossbar  switch  provides  nonblocking  simultaneous  memory 


accesses  and  communications  among  other  functional  units.  With 
this  interconnection  organization  the  maximum  number  of  transfers 
that  can  take  place  simultaneously  is  limited  by  the  number  of 
memory  units  (or  other  functional  units)  and  the  bandwidth-speed 
product  of  the  buses  rather  than  by  the  number  of  paths  available 
(Fig.  2.2).  To  provide  maximum  simultaneous  transfers,  each 
crosspoint  must  be  capable  of  switching  parallel  transmission  and 
resolving  possible  conflicts  among  requesting  units. 

Since  the  number  of  crosspoints  grows  exponentially,  the 
cost  of  the  circuitry  required  for  the  switching  facilities 
becomes  significantly  high  when  the  number  of  switch  ports  is 
large.  There  is  only  one  path  between  a  source-destination  pair. 
If  a  crosspoint  should  fail,  a  destination  becomes  unreachable 
from  the  correspondent  source.  The  expansion  of  a  system  can  be 
done  by  adding  additional  modules  of  crosspoints. 

There  are  a  number  of  examples  of  systems  utilizing  crossbar 
interconnection  organization  and  its  variations.  The  examples 
include  the  Burroughs  Multi- Interpreter  System,  RCA  215  system, 
and  Carnegie-Me lion  C.mmp  system  [17,18]. 

C.  Multiport  Memory  Systems 

In  this  organization,  the  control,  switching  and  priority  arb 
tration  logic  is  concentrated  at  the  interface  to  the  memory  units 
Each  processor  has  access  through  its  dedicated  bus  to  all  memory 
units  (Fig.  2.3).  Memory  access  conflicts  are  resolved  by  assign¬ 
ing  permanently  designated  priorities  to  each  memory  port. 

Since  each  processor  has  access  through  its  own  bus  to  all 
memory  modules  it  is  possible  to  configure  a  fully  connected 
crossbar  topology  with  a  multiport  memory  system  to  have  a  very 
high  transfer  rate  in  the  overall  system.  However,  the  multiport 
memory  systems  have  a  large  number  of  interconnections  between 
processor  and  memories.  Also  the  multiport  memory  system  has 
limits  on  its  flexibility  since  conflicts  are  resolved  through 
priorities  implemented  via  hardware. 

The  multiport  memory  organizations  are  often  found  in  large 
systems.  The  examples  include  the  Univac  1108  system  and  the 
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D.  Multistage  Interconnection  Networks 

Many  of  the  large  computer  systems  that  are  being  used  and 
designed  today  have  interconnection  networks.  In  most  of  these 
systems,  the  interconnection  networks  constitute  the  heart  of 
the  systems  which  can  be  modelled  as  shown  in  Fig.  2.4  or  Fig.  2.5. 
The  essential  elements  of  an  interconnection  network  include  a 
set  of  input  lines,  a  set  of  output  lines,  a  set  of  control  lines 
and  the  related  connective  logic  which  consists  of  switching 
elements  and  communication  links. 

There  are  a  number  of  variations  of  interconnection  networks 
depending  on  the  functional  requirements,  the  control  scheme  and 
many  other  factors.  Usually  the  connective  logic  is  organized 
into  several  stages  of  switching  elements  and  connection  links  to 
achieve  full  connections.  The  multistage  interconnection  networks 
allow  processor-to-memory  and  processor-to-processor  communications 
in  a  more  general  way  than  the  other  three  organizations  do.  When 
a  system  consists  of  numerous  functional  modules  the  multistage 
interconnection  network  becomes  the  dominant  interconnection 
organization. 

The  interconnection  organization  used  in  ILLIAC  IV  can  be 
considered  as  a  special  case  of  the  multistage  interconnection 
network  (Fig.  2.6).  The  flip  network  in  STARAN  represents 
another  example  [19]. 

E.  Others 

Some  systems  have  mixed  interconnection  organization.  The 
Pluribus  system  [20,21]  is  an  example  [6].  This  system  is  used 
as  a  modular  switching  node  for  the  ARPA  network.  It  consists 
of  seven  processor  buses  with  two  processors  and  two  4K  memories 
attached  to  each  other.  There  are  also  memory  and  I/O  buses. 

The  seven  dual  processors  share  two  banks  of  two  memory  modules 
in  an  organization  of  multiport  structures. 

Reviewing  the  evolution  of  the  computer  systems,  one  can  find 
that  for  the  past  three  decades  tremendous  progress  in  device. 
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circuit  technology  and  miniaturization  techniques  have  been  used  to 
construct  high  speed  sequential  processing  computer  systems.  The 
number  of  functional  modules  is  fixed  and  limited,  and  the  func¬ 
tional  modules  are  tightly  coupled.  However,  as  improvement  in 
switching  speed  reaches  a  limit,  it  is  obvious  that  any  further 
significant  increase  in  processing  speed  can  be  obtained  only  by 
concurrent  processing  of  a  number  of  data  sets.  To  this  end, 
various  multiple-processor  systems  have  been  proposed  and  con¬ 
structed.  We  are  reaching  the  point  to  develop  a  new  efficient 
interconnection  organization  for  such  multiple-processor  systems. 
Recent  advances  in  LSI  technology  also  facilitate  this  new  archi¬ 
tecture  trend  [9,10],  It  is  now  economically  feasible  to  construct 
a  processing  system  by  interconnecting  a  large  number  of  processors 
and  memory  modules.  However,  when  the  number  of  functional  modules 
in  a  system  increases  to  a  certain  level,  say  the  order  of  100, 
the  choice  of  interconnection  organizations  becomes  a  critical 
problem.  People  are  even  considering  to  obtain  a  multiple-pro¬ 
cessor  system  by  interconnecting  as  many  as  10  functional  modules. 
System  performance  and  practical  feasibility  of  such  multiple- 
processor  systems  would  be  terribly  limited  if  the  conventional 
interconnection  organization  such  as  time  shared  or  common  bus, 
crossbar,  or  multiport  memory  is  used.  Thus  one  of  the  exciting 
challenges  in  the  field  of  computer  architecture  is  to  design  an 
efficient  and  practical  intercommunication  subsystem  of  multiple- 
processor  systems. 

2 . 2  Review  of  Multistage  Interconnection  Networks 

As  interconnection  organization  becomes  an  important  research 
topic  for  multiple-processor  systems,  the  multistage  interconnection 
networks  should  receive  special  attention.  The  multistage  intercon¬ 
nection  networks  are  used  in  many  areas  such  as  telephone  switching, 
data  alignment  between  memory  modules  and  processors,  permutation 
generators,  and  data  sorting,  etc.  This  section  provides  a  brief 
review  on  these  multistage  interconnection  networks  (with  N  inputs 
and  N  outputs)  which  are  classified  into  the  following  four  categories 


A.  Strict ly  Nonblocking  Network 

A  network  which  can  connect  any  idle  input  to  any  idle  output 

regardless  of  what  other  connections  are  current  in  progress  is 

called  a  strictly  nonblocking  network.  There  exist  at  least  three 

construction  methods.  The  rectangular  switch  with  N  x  N  cross- 

points  is  a  strictly  nonblocking  one.  In  1953,  Clos  gave  an 

explicit  construction  [22].  A  three-stage  Clos  nonblocking 

network  constructed  from  a  number  of  smaller  crosspoint  switches 

(matrix  boxes)  is  shown  in  Fig.  2.7  with  m  1  2n-l.  Clos  has 

2 

shown  that  the  network  has  less  than  N  crosspoints  for  N  >  24 

and  in  general  it  requires  asymptotically  cN  exp [2  (/log^N  ] 

crosspoints.  The  type  of  networks  shown  in  Fig.  2.7  can  be 

generalized  to  the  2k  -  1  stage  case  by  iteratively  applying  the 

construction  rule  to  matrix  boxes  in  the  center  stage  k-  1  times. 

The  third  method  given  by  Cantor  [23,24]  is  based  on  a  three- 

stage  network  somewhat  related  to  the  Clos  three-stage  networks. 

The  construction  is  shown  in  Fig.  2.8  in  which  M  is  a  nonblocking 

network  and  L'  is  the  mirror  image  of  L.  L  is  not  nonblocking  but 

it  is  designed  in  such  a  way  that  regardless  of  the  state  it  is 

in,  if  there  is  an  idle  input  there  are  available  paths  to  connect 

it  to  more  than  b/2  of  its  outputs  (Fig.  2.8).  It  requires 

2 

asymptotically  2N(log2N)  crosspoints.  For  N  >  100,000  the  Clos 
network  is  not  as  good  as  the  Cantor  network  in  terms  of  cross- 
point  count. 

Strictly  nonblocking  networks  have  found  very  limited  appli¬ 
cations  since  some  alternative  networks  which  are  simpler  to 
manufacture  and  to  control  can  be  built  with  very  low  blocking 
probability. 


B .  Wide  Sense  Nonblocking  Network 

A  network  which  can  handle  all  possible  connections  without 
blocking  but  can  do  so  only  if  specific  routing  rules  are  used 
to  make  its  connections  is  called  a  wide  sense  nonblocking  network. 
As  pointed  out  in  [25],  Clos  networks  with  m  =  [3n/2]  are  wide 
sense  nonblocking  and  such  networks  have  fewer  crosspoints  than 
the  strictly  nonblocking  Clos  network  (m  =  2n  -  1)  with  the  same 
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number  of  inputs.  However,  there  is  no  proof  whether  this  holds 
for  more  general  cases.  Furthermore,  there  may  be  no  advantage 
in  requiring  only  the  wide  sense  nonblocking  condition  rather 
than  the  strict  sense  nonblocking  condition. 


C.  Rearrangeable  Nonblocking  Network 

A  network  is  called  rearrangeable  nonblocking  network  if  it 
can  perform  all  possible  connections  between  inputs  and  outputs 
by  rearranging  its  existing  connections  so  that  a  connection  path 
for  a  new  input-output  pair  can  always  be  established.  The  class 
of  networks  shown  in  Fig.  2.7  is  rearrangeably  nonblocking  if  and 
only  if  m  t  n.  The  above  statement  is  called  the  Slepian-Duguid 
theorem. 

Benes  [26]  has  given  the  general  construction  scheme  for  a 
multistage  rearrangeable  network  to  have  the  minimal  number  of 
crosspoints.  If  N  can  be  factored  into  its  k  prime  factors, 

N=  2ai3a2. .  .p,a  k,  Benes  algorithm  leads  to  a  (2£  a.  -1)- stage 

k  j-1  J 

network  if  the  largest  prime  factor  exceeds  three  or  if  it  equals 

k 

three  and  N  is  odd,  or  a  (21  a'.-3)  -  stage  network  if  the  largest 

j-l  J 

prime  factor  equals  three  and  N  is  even.  The  number  of  crosspoints 
required  is  equal  to  C(N)  and 

if  N  -  6  or  N  is  prime 

C(N)=  N^P  +  2D(N/p)  if  N  >  6  and  either  p  >  3  or  N  is  odd 

2N  D(N/2)  if  N  >  6  in  all  other  cases  (i.e.  ,  p  *=  2,  or  p  *  3 


and  N  is  even) , 


where  p  is  the  largest  prime  factor  in  N  and 


D(N/p)  =  l  pa  -  p. 
j-1  2  2 

If  N  is  prime  and  N  >  6,  this  construction  may  require  more  cross¬ 


points  than  an  unprimed,  slightly  larger  N. 

The  special  case  of  N  *  2n  has  been  considered  for  permuta- 

3 

tion  purposes  [27,28].  An  example  of  N  -  2  is  shown  in  Fig.  2.9. 

Fig.  2.9(a)  shows  the  first  iteration  of  Benes  construction  scheme 

and  Fig.  2.9(b)  shows  the  resulting  network.  In  general  2n  -  1 

stages  are  needed  and  the  required  number  of  2  x  2  switching 

N 

elements  is  equal  to  (2n  -  1) .  Opferman  and  Taso-Wu  [29]  have 


studied  the  control  problem  of  this  case  and  have  shown  O(NlogN) 
steps  of  computation  are  needed  if  an  associative  memory  or 
proper  amount  of  memory  is  used. 

Another  interesting  topic  concerns  the  maximum  number  of 
connections  which  must  be  disrupted  to  establish  a  new  connection. 
Some  references  and  expansions  can  be  found  in  Benes’  work  [26]. 

D.  Blocking  Network 

A  network  which  can  perform  many  but  not  all  possible  con¬ 
nections  between  terminals  is  called  a  blocking  network.  The 
blocking  networks  are  almost  always  found  in  practical  designs. 

A  survey  on  some  specific  interconnection  networks  of  the  blocking 
type  was  made  by  Thurber  [30].  In  the  following  we  review  some 
blocking  networks  which  are  chosen  under  the  emphasis  on  the 
uniform  structure  and  recent  advances. 

1.  Four-Stage  Telephone  Switching  Network: 

The  four-stage  network  shown  in  Fig.  2.10  is  commonly 
found  in  telephone  central  offices.  Benes  [26,  p.  123]  shows 
that  only  a  vanishingly  small  fraction  of  all  possible  per¬ 
mutations  can  actually  be  achieved  by  a  four-stage  network 
with  m  =  10  and  N=  1000.  However  a  rearrangeab le  network  of 
N =  1024  which  can  achieve  all  permutations  using  2  x  2 
switching  elements  turns  out  to  need  17  stages  instead  of  4. 
The  simplicity  and  the  uniform  structure  of  the  four-stage 
networks  are  attractive  for  the  interconnection  network  design 

2.  Series-Parallel  Network: 

The  series-parallel  networks  are  defined  by  Pippenger 
[31]  to  derive  exact  expressions  for  the  blocking  probability. 
The  scheme  to  obtain  a  series  connection  is  shown  in  Fig.  2.11 
In  Fig.  2.11,  there  is  one  link  between  a  given  primary  and 
a  given  secondary.  Fig.  2.12  shows  the  scheme  to  obtain  a 
parallel  connection  in  which  there  is  one  link  between  a 
given  primary  and  a  given  secondary,  and  one  link  between  a 
given  secondary  and  a  given  tertiary.  A  series-parallel 
network  is  then  defined  as  the  one  that  can  be  constructed 
by  starting  with  switching  matrices  and  applying  the  rules 
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Fig.  2.12  Parallel  connection  (n *  n 


for  series  and  parallel  schemes  any  number  of  times,  in  any 
order.  Pippenger  concluded  that  networks  can  be  constructed 
with  less  than  6N  log„N  +  0(N  log  log^)  crosspoints  where  B 

Z  D 

is  the  expected  blocking  probability. 

3.  Banyan  Network: 

A  banyan  has  been  defined  as  a  tropical  tree  having 
many  aerial  roots  that  develop  into  additional  trunks.  A 
graph  of  a  banyan  is  shown  in  Fig.  2.13  [30]  in  which  there 
is  one  and  only  one  path  from  any  base  to  any  apex. 

Lipovski  and  Goke  specified  two  banyan  structures  [32,33] 
and  proved  a  number  of  theorems  relating  to  banyan  networks. 
These  two  structures  are  SW  and  CC  (cylindrical  crosshatch) 
banyan  structures.  The  SW  structure  recursively  expands  to 
a  crossbar  switch  as  illustrated  in  Fig.  2.14.  The  CC  struc¬ 
ture  is  rectangular  by  definition  and  must  have  vertices 
at  each  level  where  S  is  the  spread  of  the  vertices  and  L  is 
the  level.  A  CC  banyan  network  is  shown  in  Fig.  2.15  in 
which  L=3  and  S=2.  Some  special  cases  of  banyan  networks 
have  been  proposed  in  a  processor  system  architecture  [ 34 ] . 

4.  Omega  Network: 

Lawrie  developed  an  algorithm  to  construct  connection 

networks  based  on  the  concept  of  an  omega  base  representation 

of  integers  [35,36].  Let  R  be  an  ordered  set  of  integer 

n 

factors  of  n,  i.e.,  =  (p  ,...,p^)  and  p^^.-.p^  =  n,  and 

set  fi(R  )  =  {W.  |W,  =  W  -  *p  ,  W,  =1,  0  <  i  <  k-1).  Using 
n  i'  i  l+l  i+1  k 

ft(R  ),  Lawrie  constructs  an  omega  network.  The  omega  network 
n 

consists  of  k  stages  (numbered  1,  2,  ...,  k  from  left  to 
right).  The  ith  stage  is  composed  of  n/p^  crossbar  switches, 
each  switch  p^  by  p^.  At  each  stage  the  inputs  and  outputs 
are  labelled  from  0  to  n-  1  respectively.  Connections  are 
made  by  connecting  output  j  of  stage  i  to  input  Z  of  stage  i+1 
where  l  =  (j  +  (j  mod  p^  •Wi  +  (j  mod  W^)  ip., 

where  X  t  Y  is  the  integer  part  of  the  quotient  X/Y.  The  input 
line  in  stage  1  should  be  renumbered  in  a  special  way.  A 
network  control  algorithm  is  also  provided.  An  omega  network 
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with  n  =  8  is  shown  in  Fig.  2.16. 

5.  Data  Manipulator: 

The  data  manipulator  [37,38]  is  designed  to  achieve  a 
set  of  data  manipulation  functions  in  parallel  processing. 
There  are  four  variable  parameters  in  the  design: 

(a)  the  number  of  communication  paths  of  each  cell; 

(b)  the  number  of  control  line  groups; 

(c)  the  number  of  manipulator  columns;  and 

(d)  the  interconnection  paths  between  cells. 

Appropriate  control  of  these  parameters  could  produce  a 
suitable  data  manipulator  in  accordance  with  the  specifica¬ 
tion.  Figure  2.17  shows  an  example  of  three  columns  and  six 
control  groups.  The  interconnection  path  is  such  that  cell  X 
in  column  21  is  connected  to  cell  X  and  to  the  cells  which 
differ  from  X  in  21  position  in  the  adjacent  column.  Thus 
the  required  number  of  stages  is  log2N.  The  number  of 
communication  paths  shown  in  Fig.  2.17  is  equal  to  three. 

The  six  control  groups  are  shown  in  Fig.  2.18. 

6.  Versatile  Line  Manipulator: 

The  versatile  line  manipulator  is  capable  of  achieving 
almost  all  the  data  manipulation  functions  [39].  Figure  2.19 
shows  a  block  diagram  of  the  versatile  line  manipulator. 

There  are  N  *  N  cells  (Fig.  2.20)  in  the  basic  line- 
manipulator  circuit  (BLMC)  .  The  output  gate  (OG)  of  cell  (i,j)  is 
controlled  either  by  the  ith  address  control  register  (through 
a  decoder)  or  by  a  combination  of  the  input  and  output  control 
registers.  The  ith  address  control  register  determines  the 
location  of  OG  in  the  ith  BLMC  row  to  be  activated.  Thus, 
only  one  OG  in  each  BLMC  row  can  be  activated  at  a  time  while 
there  could  be  up  to  N  OG's  activated  in  each  column  by  pro¬ 
viding  the  same  addresses  for  the  address  control  registers. 

A  versatile  data  manipulator  has  been  implemented  in  STARAH 
[40]. 
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Column 

Number 


2 


2 


2 


0 


CR  Control  register  (c) 

1MR  Input  mask  register  (u.) 

OMR  Output  cask  register  (y^) 

Fig.  2.17  A  data  manipulator  for  8  items. 
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ACR  Address  Control  Register 

BLMC  Basic  Line-manipulator  Circuit 

ICR  Input  Control  Register  (o  ) 

IMR  Input  Mask  Register  (p*) 

OCR  Output  Control  Register  (oQ) 

OMR  Output  Mask  Register  (p  ) 


Fig.  2  .19  A  versatile  line  manipulator  (VLM) . 
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From  Cell  (i-l,j) 
(from  j-th  Bit  of 
1MR  if  i®0) 


From  Cell  (i-l,j) 
(from  j-th  bit  of 
ICR  if  i-0) 


if  i=2n-l)  if  i*2n-l) 


Fig.  2.20  The  logic  circuit  of  BLMC  Cell  (i,j). 


7.  Expanded  Shuffle-Exchange  Network: 

The  perfect  shuffle  permutation  was  used  by  Pease  [41] 
in  1968.  Stone  [42]  constructed  a  folded  one-stage  network 
which  can  perform  an  exchange  and  a  shuffle  function.  In  a 
later  paper  a  simple  control  mechanism  is  added  to  allow  some 
permutations  [43].  The  control  scheme  requires  only  one  bit 
per  cell  and  the  bit  value  is  determined  by  an  EXCLUSIVE  OR 
operation  of  the  bit  values  in  the  previous  step.  The 
shuffle-exchange  functions  have  been  found  useful  in  some 
processing  applications.  An  expanded  multistage  shuffle- 
exchange  network  is  shown  in  Fig.  2.21. 

8.  Flip  Network: 

The  flip  network  [19]  scrambles  and  unscrambles  data  for 
the  MDA  memory  [44].  It  can  also  perform  the  processor-to- 
processor  routing  required  for  many  problems.  Fig.  2.22 
shows  an  8-item  flip  network  for  flip  permutations.  Each 
stage  is  controlled  by  a  control  bit.  If  the  control  bit  is 
1  the  stage  performs  crossed  connecting,  otherwise  the  direct 
connection  is  performed.  A  network  shown  in  Fig.  2.23  with 
modified  control  structure  can  perform  some  shift  permutations. 

9.  Indirect  Binary  n-Cube  Network: 

The  indirect  binary  n-cube  network  is  used  to  permute 

data  in  a  microprocessor  array  [45].  The  basic  form  of  the 

indirect  binary  n-cube  is  illustrated  in  Fig.  2.24  for  n  =  4, 

4 

N=2  =16.  The  circles  in  Fig.  2.24  represent  the  micro¬ 
processors,  indexed  from  0  to  (2°  -  1)  as  indicated  by  the 
numbers  in  the  circles.  The  lines  on  the  right  from  the 
switching  network  connect  back  to  the  microprocessors  with 
the  indices  given  in  parenthesis.  The  network  uses  switching 
elements  with  direct  and  crossed  connection  capabilities  and 
allows  multiple  passes  to  obtain  permutations  of  data.  A 
control  system  using  global  command  which  can  be  broadcast  to 
all  microprocessor  and  a  set  of  switch  controllers  is  sug¬ 
gested. 
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Fig.  2  .24  The  indirect  binary  4-cube  network. 


E.  Triangular  Network 


For  the  one-sided  case  where  both  inputs  and  outputs  are  on 
the  same  side,  a  triangular  array  as  shown  in  Fig.  2.25  can  be 
used  for  construction.  The  straight  way  to  construct  a  nonblocking 
triangular  network  of  size  N  is  to  use  the  triangular  array  shown 
in  Fig.  2.25  which  uses  N(N-l)/2  crosspoints.  A  variation  of  the 
Clos  network  [22]  as  shown  in  Fig.  2.26  can  be  used  to  improve  the 
crosspoint  count.  The  crosspoints  in  the  intermediate  switches 
permit  connections  between  all  switches  on  the  left-hand  side. 

For  connections  between  terminals  on  the  same  switch,  each  input- 
output  switch  can  be  built  up  with  an  additional  triangular  por¬ 
tion  to  permit  connections  within  the  switch  since  the  triangular 
switch  in  the  second  stage  is  good  only  for  connections  between 
two  distinct  switches.  The  triangular  network  is  nonblocking  for 
m  >  2n  -  1  in  Fig.  2.26 

Another  triangulai  network  construction  is  the  triangular 
interconnection  array  [46,47 ]  as  shown  in  Fig.  2.27. 

As  pointed  out  by  Thurber  [30],  it-  is  very  difficult  to  make  a 
comparison  of  interconnection  networks.  There  are  many  parameters  that 
should  be  considered  in  designing  an  interconnection  network.  It  is 
not  quite  acceptable  to  justify  networks  just  in  terms  of  a  partial 
set  of  parameters.  However,  comparative  information  is  helpful  to 
design  work.  Some  comparative  studies  were  mady  by  Siegal  [48-50]. 

Generally  speaking,  the  non-blocking  characteristic  is  not  the 
prime  criterion  for  choosing  network  structure.  Instead,  blocking 
networks  with  uniform  structure  are  always  found  in  practical  usage  and 
proposed  schemes.  Among  those  blocking  networks,  the  complexity,  number 
of  units  required,  propagation  stages,  etc.,  do  not  differ  significantly 
between  approaches.  In  other  respects,  work  on  complexity  analysis  of 
networks  has  been  on  the  minimization  of  crosspoints  and  logic  parti¬ 
tioning  of  the  circuit.  Recent  advances  in  LSI  technology  relatively 
cut  down  the  merit  of  this  minimization  criterion  and  also  lead  to  new 
computer  architecture  trends.  With  this  background,  one  should  consider 
some  new  design  concepts  which  are  described  in  the  following  section. 


2. 3  General  Design  Criteria 

As  the  complexity  of  computer  systems  grows  because  of  the  tech¬ 
nology  advances  and  the  processing  requirements,  the  interconnection 
philosophy  should  be  re-evaluated  to  fit  the  new  architectural  trend. 

A  systematic  approach  to  the  design  of  digital  bussing  structure  was 
previously  discussed  [15].  However,  facing  the  rapid  technology 
advances  in  recent  years  and  the  processing  requirements,  we  have  to 
add  some  new  design  criteria. 

A.  Operational  Modes 

The  interconnection  network  can  function  in  two  modes: 
synchronous  and  asynchronous.  In  the  synchronous  mode  all  con¬ 
nection  paths  are  centrally  supervised  and  they  all  are  set-up  and 
disconnected  at  the  same  time.  On  the  other  hand,  in  the  asyn¬ 
chronous  mode,  a  connection  path  can  be  set  up  or  disconnected  on 
ar  individual  basis.  Synchronous  operations  can  be  found  in 
parallel  processing  such  as  data  alignment  between  parallel  pro¬ 
cessors  and  memories.  The  asynchronous  operation  is  more  general 
and  involves  much  more  architecture  and  control  complexity  than  the 
synchronous  operation  does. 

B .  Switching  Methodologies 

There  are  three  possible  switching  methodologies  for  support¬ 
ing  general  networking  requirements:  circuit  switching,  packet 
switching,  and  integrated  circuit-packet  switching.  Circuit 
switching  involves  the  establishment  of  dedicated  path  between 
two  terminal  units  [19,32-40].  In  some  circumstances  such  as 
short  message  transfer,  the  circuit  switching  is  relatively 
inefficient.  On  the  other  hand,  bulk  data  is  believed  to  be  more 
suitable  for  circuit  switching.  In  contrast  to  circuit  switching, 
packet  switching  attempts  to  multiplex  the  use  of  the  communication 
circuit  among  all  related  terminal  units  [51,52].  Messages  are 
typically  broken  into  a  series  of  fixed  length,  addressed  packets 
of  data  which  are  routed  independently  to  their  destination  using 
store-and-forward  procedures.  The  packet  switching  can  partially 
solve  the  blocking  problem  of  the  interconnection  network.  However, 


it  also  increases  the  complexity  of  the  routing  procedure  and  the 
cost  of  the  system.  A  compromise  solution  for  the  short  message 
and  the  bulk  data  is  the  integrated  circuit-packet  switching. 

C.  Routing  Techniques 

The  routing  techniques  of  the  intercommunication  subsystem 
in  a  large  multiple-processor  system  is  no  longer  simple  as  those 
for  bus  lines.  The  technique  involves  computing  the  available 
path,  and  resolving  conflicts,  etc.  Essentially  three  techniques 
have  been  considered:  centralized,  distributed  and  adaptive.  In 
a  centralized  routing  scheme  (29],  a  central  authority  takes  over 
all  logic  decisions  which  are  needed  to  set  up  the  intercommuni¬ 
cation.  One  of  the  disadvantages  [52]  of  centralized  routing  is 

that  the  central  authority  becomes  very  difficult  to  implement 

14 

when  the  number  of  processors  increases  td  as  large  as  2  .  A 

local  distributed  routing  technique  may  be  used  to  overcome  this 
disadvantage.  However,  there  is  no  coordination  among  the  local 
decisions  and  hence  the  resource  in  the  subsystem  may  not  be  used 
efficiently.  An  adaptive  scheme  can  then  be  implemented  by 
collecting  the  subsystem  status  information  and  making  routing 
decisions  locally. 

D.  Communication  Techniques 

The  communication  techniques  become  more  critically  important 
since  there  could  be  more  than  one  decision  point  along  a  path  set 
up  in  an  interconnection  network.  There  are  several  protocol 
communication  levels  such  as:  link  control,  switching  element- 
to-switching  element,  and  terminal-to-terminal.  The  synchroni¬ 
zation  problem  is  a  difficult  one.  Various  techniques  [53,54] 
should  be  carefully  reviewed  in  order  to  tackle  the  problem  more 
effectively. 

E.  Interconnection  Network  Structure 

The  system  performance  and  cost  of  intercommunication  sub¬ 
systems  largely  depend  on  the  interconnection  network  structure. 
The  time-shared  or  common  buses  cannot  fit  for  the  system  with  a 
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large  number  of  processors  and  memory  modules.  Crossbar  switches 
have  two  disadvantages  as  described  in  Section  2.1.  The  multiport 
memory  scheme  can  also  cause  large  circuit  components  if  the  number 
of  the  processor  units  becomes  large.  The  multistage  intercon¬ 
nection  network  represents  a  feasible  approach  from  both  the  func¬ 
tional  and  cost  points  of  view.  However  the  multistage  network 
should  be  partitioned  in  such  a  way  that  the  building  block  modules 
are  cost  effective  for  LSI  implementation  and  software  development. 

F.  Interaction  Level 

One  of  the  important  questions  is  what  interaction  level  the 
interconnection  network  should  have  in  relation  to  other  sub¬ 
systems.  A  preferred  design  in  the  distributed  processing  [8]  is 
that  the  interconnection  network  becomes  an  autonomous  subsystem 
and  interacts  with  other  subsystems  by  message  transaction.  The 
unit  of  message  transaction  may  be  set  as  a  file,  a  data  set  or 
an  instruction. 

G.  Design  Tools 

For  a  large  interconnection  network  the  performance  can  be 
improved  through  the  analysis  of  the  entire  system  [55].  Some 
parameters  such  as  the  message  size,  number  of  buffers,  etc.,  may 
be  set  arbitrarily  and  get  tuned  to  optimized  values  thereafter. 

The  tools  for  the  analysis  should  be  planned  and  incorporated  into 
the  system. 

H.  Others 

Some  other  decisions  should  also  be  made  for  designing  inter¬ 
communication  subsystems.  These  include  traffic  classification, 
serial  or  parallel  transmission,  digital  or  analog  signals,  fault 
diagnosis  scheme,  correcting  structure,  etc. 

2 . 4  Characteristics  of  Interconnection  Networks 

To  facilitate  the  communication  between  the  user  and  the  designer 
and  to  set  a  goal  for  the  design,  a  set  of  specifications  on  the  interconnec 
tion  networks  should  be  developed.  Some  characteristics  which  can  be 
used  to  specify  the  interconnection  network  are  identified  as  follows: 
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A.  Topology  of  Interconnection  Network 

The  topology  Includes  the  communication  paths  of  each 
switching  element,  the  connectivities  of  the  communication  links 
and  the  number  of  switching-element  stages. 

B.  Control  Structure  of  Interconnection  Networks 

The  control  structure  can  be  classified  into  three  categories 
[50]:  individual  stage  control,  individual  box  control,  and 

partial  stage  control. 

C.  Logical  Complexity 

This  refers  to  the  totality  of  decisions  made  during  commu¬ 
nication.  It  should  be  as  small  as  possible. 

D.  Blocking  Probability 

This  quantity  is  used  to  measure  the  probability  with  which 
an  intercommunication  subsystem  responds  to  transfer  requests 
from  the  terminal  unit. 

E.  Message  Response  Time 

There  are  two  meaningful  measures  on  response  time:  terminal 
response  time  and  overall  response  time.  The  terminal  response 
time  is  defined  to  be  the  time  required  from  the  instant  the 
transmit  is  sent  to  the  moment  the  reply  message  begins  to  appear 
at  the  terminal.  The  overall  response  time  is  the  elasped  time 
from  the  instant  a  message  arrives  at  a  terminal  to  the  moment  the 
message  is  completely  served. 

F.  System  Capacity  or  Throughput 

The  capacity  is  defined  as  the  maximum  traffic  that  a  system 
can  carry,  while  satisfying  the  blocking  probability  criterion, 
and/or  response  time  requirements. 

G.  Network  Reliability 

The  reliability  can  be  defined  as  the  mean  time  between  two 
failures  (MTBF)  and  the  average  man  hours  required  for  a  repair. 
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H.  Sensitivity 

This  is  the  effect  that  the  system  would  experience  if  the 
actual  traffic  is  above  the  project  or  if  some  tolerant  faults 
appear  in  the  network. 

I .  Traffic  Bottleneck  or  Deadlock 

This  is  an  inherent  performance  limitation  due  to  a  non- 
uniform  flow  of  communication  or  to  saturation  of  a  shared 
resource . 

J .  Transmission  Error  Rate 

The  error  rate  is  a  function  of  message  size,  line  condition 
and  hardware  characteristics.  It  should  be  calculated  in  order 
to  decide  whether  the  error  correction  circuit  is  needed. 

K.  Cost 

There  are  tradeoffs  for  cost/performance .  Technology  advances 
allow  design  alternatives.  A  set  of  curves  to  weigh  and  compare 
the  tradeoffs  can  be  developed.  It  is  the  designer's  responsibility 
to  design  a  least  cost  network  while  satisfying  the  requirement. 

2 . 5  Network  Hardware  and  Software  Design  Issues 

There  are  mutual  relationships  among  the  network  hardware  and 
software  design,  the  choice  of  network  design  decisions  and  network 
specifications.  Since  the  factors  affecting  the  hardware  and  software 
design  vary  case  by  case,  we  discuss  only  the  general  issues  in  this 
section. 


A.  Network  Hardware  Design 

Some  hardware  features  associated  with  switching  matrix, 
network  control,  linkage  and  connectivity,  synchronization,  and 
functional  unit-network  interface  are  discussed. 

1.  Switching  Matrix: 

The  required  features  in  a  switching  matrix  can  be 
classified  into  two  parts:  controller  and  transfer  unit. 

a.  Controller:  The  complexity  of  a  controller  largely 
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depends  on  the  control  technique  and  the  switching  method. 

The  simplest  is  probably  the  one  which  uses  the  circuit 
switching  and  the  central  control  technique.  In  this  case 
the  switching  matrix  receives  control  signals  from  the  control 
center  and  stores  them  in  registers  to  set  up  the  connection 
path  in  the  transfer  unit.  Another  possibility  is  to  use 
the  circuit  switching  and  the  distributed  control  technique. 
The  controller  should  be  able  to  receive  destination  infor¬ 
mation  from  its  neighbors,  decode  it,  resolve  conflicts  and 
dispatch  proper  control  signals  to  the  transfer  unit. 

Obviously  the  controller  should  have  the  logical  decision 
ability  and  some  memories  should  be  included  for  conflict 
table  usage.  The  controller  for  the  packet  switching  is  not 
less  complex  than  the  one  previously  described.  Some  impor¬ 
tant  issues  include  the  buffer  management  and  the  routing 
table  updating.  Another  important  aspect  is  the  reliability 
consideration.  A  self-fault-detection  mechanism  should  be 
installed  to  make  sure  that  the  switching  matrix  is  properly 
functioning,  or  otherwise  inform  the  fault  to  the  neighbors 
and  the  global  network  control  center.  Since  the  dynamic 
decision  capability  should  be  built  into  the  controller  to 
fulfill  the  requirements  of  the  distributed  control,  the 
inexpensive  microprocessors  provide  a  great  potential  for 
this  need  [56-58].  In  the  near  future  the  dynamic  distributed 
microprocessor  switching  matrix  will  certainly  replace  the 
static  switching  matrix  in  the  interconnection  network. 
However,  the  logical  complexity  should  be  made  low  and  the 
size  of  the  switching  matrix  should  be  properly  chosen  in 
order  not  to  overload  the  microprocessor  controller. 

b.  Transfer  unit:  In  the  circuit  switching  mode  the 
transfer  unit  is  a  connection  network  in  which  a  connection 
path  can  be  established  between  an  input/output  pair.  In 
the  packet  switching  mode,  the  transfer  unit  represents  the 
buffer  pool  system.  Some  connection  networks  have  been 
implemented  [19,37-40]  and  some  have  been  proposed  [34,42]. 

In  any  circumstance,  the  connection  network  should  be  designed 
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in  such  a  way  that  the  controller  and  the  fault  diagnosis 
mechanism  can  be  relatively  simple.  The  buffer  pool  system 
can  be  implemented  by  high  speed  memory.  However,  the  DMA 
capability  of  that  memory  and  the  data  structure  of  buffers 
are  critical  factors  involved  in  time  delay. 

2.  Network  Control  Unit: 

There  are  several  reasons  that  a  network  control  unit 
should  exist.  Among  the  reasons  are  the  central  control 
for  the  circuit  switching  operation,  reliability  considera¬ 
tions  and  network  reconfiguration,  initialization  of  switching 
matrix,  and  performance  measurement.  Opferman  and  Tsao-Wu 
have  described  hardware  requirements  of  a  network  control 
unit  for  a  rearrangeable  network  [29].  For  a  large  inter¬ 
connection  network  operating  in  the  circuit  switching  mode, 
the  central  control  unit  can  be  as  complex  as  that  for 
No.  1  ESS  [59]  which  consists  of  dual  processors,  temporary 
and  semipermanent  memories,  scanner  and  distribution  units. 

The  network  control  unit  should  also  be  able  to  collect  (or 
test)  the  fault  information  and  provide  network  reconfigura¬ 
tion  by  updating  the  local  routing  tables.  The  switching 
matrix  initialization  and  the  performance  measurement  should 
also  be  controlled  by  the  network  control  unit. 

3.  Linkage  and  Connectivity: 

The  links  between  switching  matrices  provide  the  connec¬ 
tivities  between  terminals.  For  the  graceful  degradation 
reason,  there  should  be  at  least  two  disjoint  connection  paths 
existing  between  a  terminal  pair.  The  links  may  be  used  to 
transfer  not  only  data  but  also  control  signals  and  can  be 
designed  as  full  duplex,  half  duplex  or  simplex  lines. 

4.  Synchronization: 

There  are  no  significant  timing  or  synchronization 
problems  in  an  analog  communication  network.  However, 
synchronization  plays  an  important  role  in  a  digital  commu¬ 
nication  network.  The  synchronization  affects  not  only  the 
network  reliability  but  also  the  message  throughput.  It  is 


possible  to  use  master-slave  synchronization  schemes  in 
the  interconnection  networks. 

5.  Interface  between  Functional  Units  and  Network: 

Basically  the  functional  unit-network  interface  is  not 
a  part  of  the  network  under  design.  However,  its  input/ 

output  format  affects  the  functioning  of  the  network.  A 
sophisticated  interface  should  be  used  to  handle  the  inter¬ 
actions  between  a  functional  unit  and  the  network. 

B.  Network  Software  Design 

It  is  essential  to  have  a  set  of  basic  routing  procedures  to 
insure  an  efficient,  correct  and  smooth  transfer  of  information 
in  the  interconnection  network  system.  In  general  this  basic 
routing  procedure  can  be  partitioned  into  four  categories  [60, 
61]. 

1.  Communication  Protocols: 

A  communication  protocol  is  a  set  of  rules  established 
to  manage  the  information  exchange  between  two  terminal 
units.  The  protocol  allows  the  terminal  units  to  understand 
one  another  and  to  cooperate  with  one  another.  A  good 
communication  protocol  can  result  in  short  delay  time  and 
high  throughput.  Usually  protocols  can  be  classified  into 
several  levels. 

2.  Flow  Control  Procedures: 

Flow  control  procedure  [62]  regulates  the  input  amount 
and  rate  that  an  interconnection  network  can  accept  in  order 
to  prevent  or  minimize  the  occurrence  of  traffic  congestion 
and  deadlock.  There  are  two  problems  which  should  be  worked 
out  in  the  flow  control  procedures.  The  first  one  is  to  mi¬ 
nimize  the  occurrence  of  congestion  and  deadlock.  The 
second  one  is  to  handle  the  congestion  and  the  deadlock  if 
they  unfortunately  occur.  In  circuit  switching  mode,  the 
connection  request  car,  be  abandoned  or  deferred  if  this 
connection  request  should  result  in  congestions.  In  packet 
switching  mode,  the  buffer  regulation  scheme  of  the  computer 


communication  can  be  used.  There  are  two  existing  congestion 
control  methods  [63]  for  packet  switching, which  can  be  classi¬ 
fied  as  "local"  and  "end-to-end".  An  overflow  buffer  scheme 
is  used  to  thwart  the  deadlock  in  the  packet  switching  of 
computer  communications.  Careful  study  should  be  made  to 
apply  the  developed  schemes  in  the  newly  investigated  multistage 
interconnection  network  system. 

3.  Graceful  Degradation  Considerations: 

A  factor  of  major  importance  to  the  successful  operation 
of  the  interconnection  networks  is  their  reliability  [64,65]. 

The  effect  of  failure  in  the  switching  modes  and  links  should 
be  minimized.  Indeed  a  high  reliability  can  be  achieved  by 
having  at  least  two  disjoint  paths  between  every  pair  of 
terminal  units.  To  facilitate  this  multiple  disjoing  path, 
multiport  processor  units  should  be  developed.  However,  like 
the  duplication  reliability  scheme  in  the  telephone  switching 
system,  the  multiple  disjoint  paths  scheme  proceeds  under  the 
assumption  that  there  is  a- fault  detection  and  recovery 
process  existing  in  the  network  system.  A  network  control 
unit  is  preferred  in  addition  to  the  self-detecting  mechanism. 

The  detection  of  fault  should  induce  a  recovery  process  such 
as  rerouting,  data  restoration  and  failure  replacement 
messages . 

4.  Routing  Procedure  of  an  Intercommunication  Network: 

This  is  one  of  the  factors  which  can  influence  commu¬ 
nication  delays  and  traffic  throughputs.  In  circuit  switching, 
the  routing  procedure  establishes  a  dedicated  circuit  line 
between  source  and  destination  and  the  data  flows  through  the 
established  line.  In  packet  switching,  data  is  routed  from 
source  to  destination  without  establishing  a  dedicated  line. 

In  both  switching  modes  the  purpose  of  the  routing  procedure 
is  to  send  data  from  source  to  destination.  The  philosophy 
for  the  routing  procedure  in  both  switching  modes  is  the  same 
although  the  implementations  are  different.  Some  potential 
candidates  for  routing  procedures  are  discussed  as  follows: 
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a.  Centralized  routing  procedure:  This  procedure 
utilizes  a  central  authority  which  dictates  the  routing 
decisions  [29,36,38,45].  The  central  authority  processor 
collects  the  network  status  information,  makes  optimal  route 
decisions  and  dispatches  control  signals  to  the  network. 

b.  Distributed  routing  procedure:  In  this  procedure  the 
required  processing  for  the  routing  control  is  distributed 
over  processing  elements  within  che  network  with  several 
elements  executing  tasks  concurrently.  This  method  could 
solve  the  capacity  limitation  in  the  centralized  routing 
procedure.  Some  examples  are  listed  as  follows: 

i.  Saturation  routing  -  The  saturation  routing  means 

a  flooding  of  the  network  with  messages  which  search 
for  a  particular  identification  number  over  every 
possible  path.  In  the  saturation  routing,  a  search 
causes  all  unconnected  paths  to  be  unavailable  to 
other  simultaneous  searches.  This  disadvantage 
could  cause  high  blocking  probability  and  hence 
large  delay  time. 

ii.  Hamming  distance  decreasing  routing  -  An  addressing 
scheme  has  been  proposed  for  ring  communication 
network  using  ternary  numbers  [66].  It  uses  a 
distance  matrix  to  encode  every  switching  element 
in  such  a  way  that  the  Hamming  distance  between  two 
code  points  is  equal  to  the  distance  between  the 
correspondent  switching  elements.  It  has  been  shown 
that  the  addressing  scheme  is  good  for  any  network 
structure.  The  route  can  be  formulated  as  follows: 

If  the  search  message  arrives  at  switching  element  A, 
calculate  the  Hamming  distance  between  the  destina¬ 
tion  and  A,  and  the  Hamming  distance  between  the  destinat 
and  switching  elements  adjacent  to  A.  The  message 
is  routed  to  the  switching  element  which  is  Hamming 
distance  1  closer  to  the  destination  than  is  A.  One 
of  the  disadvantages  is  that  the  binary  code  for 
the  ternary  address  is  too  long  to  handle  if  the 


network  is  of  a  large  size. 

iii.  Table  look-up  routing  -  A  compromise  solution  to 

the  disadvantage  in  (ii)  is  the  table  look-up  method. 
In  this  method,  each  switching  element  maintains  a 
destination  table.  The  message  can  be  routed  accord¬ 
ing  to  the  table  contents.  Some  adaptive  routing 
method  can  be  implemented  by  updating  the  table 
according  to  the  network  status  information  [67,68]. 
Two  of  them  are  isolated  adaptive  routing  and 
distributed  adaptive  routing. 

iv.  Destination  tag  routing  -  If  the  location  of  the 

switching  element  is  not  restricted  by  the  geograph¬ 
ical  factors,  we  can  design  a  network  structure  from 
which  we  can  take  advantage  of  its  regularity  for 
developing  a  routing  procedure  [35].  This  routing 
scheme  should  be  extended  to  more  general  cases. 

It  might  be  necessary  to  combine  several  routing  schemes  in 
a  routing  procedure. 

2.6  Summary 

In  this  chapter,  we  have  reviewed  the  interconnection  organiza¬ 
tions  of  multiple-processor  systems  and  classified  them  into  four 
categories.  Among  these  four  interconnection  organizations  the 
multistage  interconnection  networks  have  been  receiving  increasing 
attention  because  of  the  impact  of  recent  LSI  advances.  After 
reviewing  some  specific  multistage  interconnection  networks,  we 
provided  the  general  design  criteria,  some  characteristics  of  inter¬ 
connection  networks,  and  the  hardware  and  software  requirements  for 
designing  an  intercommunication  subsystem  for  multiple-processor 
systems.  It  is  noted  that  designing  an  efficient  intercommunication 
subsystem  for  multiple-processor  systems  is  one  of  the  most  important 
challenges  in  today's  computer  architecture. 
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CHAPTER  3 

A  CLASS  OF  MULTISTAGE  INTERCONNECTION  NETWORKS 


Some  multistage  interconnection  networks  have  specifically  been 
proposed  or  implemented  during  the  past  several  years.  These  networks 
include  the  data  manipulator  (modified  version)  [38],  the  indirect 
binary  n-cube  network  [45],  the  flip  network  [19],  the  omega  network 
[35,36],  and  the  regular  SW  banyan  network  with  spread  and  fanout  of 
2(S»F=2)  [32-34].  Each  of  these  networks  consists  of  a  set  of  N 
input  terminals,  a  set  of  N  output  terminals,  log^N  stages  of  logic 
cells,  and  a  set  of  control  lines.  The  set  of  N  input  terminals  and 
the  set  of  N  output  terminals  are  two  disjoint  sets  of  terminals.  All 
of  these  networks  are  capable  of  connecting  an  arbitrary  input  terminal 
to  an  arbitrary  output  terminal.  But,  simultaneous  connections  of  more 
than  one  terminal  pair  may  result  in  conflicts  in  the  communication 
path  within  the  logic  cells. 

This  chapter  investigates  the  practical  nature  of  the  intercon¬ 
nection  networks  by  comparing  the  existing  interconnection  networks 
and  applying  them  to  the  real-world  problem.  In  Section  3.1,  we 
define  a  baseline  network  which  can  serve  as  a  reference  for  evaluating 
the  relationships  among  the  most  existing  interconnection  networks  and 
compare  the  baseline  network  to  the  existing  networks  mentioned  in 
the  previous  paragraph.  Section  3.2  describes  a  simple  routing  pro¬ 
cedure  which  can  result  in  the  same  connection  path  no  matter  which 
side  of  the  terminals  is  chosen  as  the  input  side  and  the  other  side 
as  the  output  side.  The  routing  procedure  also  includes  a  scheme 
for  the  conflict  resolution.  Section  3.3  extends  the  routing  proce¬ 
dure  to  allow  one-to-one  connections  between  all  pairs  of  terminals. 

3. 1  Isomorphic  Topology 

In  the  first  part  of  this  section  a  baseline  network  is  introduced 
Then  a  topological  equivalence  of  several  multistage  interconnection 
networks  is  given. 
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A.  Configurat  ion  I  a  Baseline  Network 

Tin  performing  of  an  Interconnection  network  is  determined 
largely  by  Its  configuration.  By  the  conf i gurat 1  on  of  an  inter¬ 
connection  network  we  mean  the  topology  and  the  label  of  the 
components  of  tile  network.  Here  we  define  the  topology  in  terms 
of  three  of  the  four  variable  parameters  for  designing  a  data 
manipulator  [381.  These  three  parameters  are  the  number  of 
communication  paths  of  each  switching  element,  the  number  of 
columns  (or  stages)  and  the  interconnection  paths  (or  links) 
between  switching  elements.  In  this  chapter  we  consider  log^N 
stages  of  2  x2  switching  elements,  i.e.,  switching  elements  each 
with  two  input  and  two  output  terminals,  and  describe  the  con¬ 
nectivities  of  the  interconnection  paths  between  switching 
elements  using  a  set  of  mathematical  rules,  called  tocology 
describing  rules,  derived  directly  from  the  structure  defini¬ 
tion  of  the  network.  Fig.  3.1  shows  a  2  x2  switching  element 
which  has  capabilities  of  direct  and  crossed  connections.  The 
logical  names  of  the  components  of  a  network  can  be  used  to 
unambiguously  identify  each  link  and  each  switching  element  in 
the  network  by  applying  some  mapping  rule  on  their  physical 
names.  A  physical  name  is  given  to  each  switching  component 
(stage,  element,  link)  for  identifying  its  relative  location  in 
the  network  in  order  to  describe  its  topology. 

Now  we  introduce  a  baseline  network  which  can  serve  as  a 
reference  for  evaluating  other  existing  multistage  networks.  The 
topology  of  the  baseline  network  can  be  generated  in  a  recursive 
way.  Fig.  3.2  shows  the  first  iteration  of  the  recursive  pro¬ 
cess  in  which  the  first  stage  contains  one  N*  N  block  and  the 
second  stage  contains  two  (N/2) x  (N/2)  subblocks,  Cq  and  C^. 

The  process  can  recursively  be  applied  to  the  subblocks  in 
each  iteration  until  the  N/2  subblocks  of  size  2x2  are  reached. 
To  complete  the  process  log^N-l  iterations  are  needed.  There  are 
log^N  stages  of  the  switching  elements  and  log^N+l  levels  of  the 
links.  There  is  a  similarity  between  this  baseline  network  and 
Batcher's  bitonic  sorting  network  [69].  It  is  therefore  possible 
to  design  a  switching  element  for  both  purposes.  A  network  of 
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N“16  is  illustrated  in  Fig.  3.3. 

The  physical  names  are  assigned  as  follows.  The  stages 
are  labelled  in  a  sequence  from  0  to  log^N-l  with  0  for  the  left 
most  stage  and  log^N-l  for  the  right  most  stage.  Similarly,  the 
levels  of  links  are  labelled  in  a  sequence  from  0  to  log2N.  In 
each  stage  each  switching  element  is  named  by  a  code  word  of 
£  *  log^N-l  binary  bits,  p^p^  ^...p^,  which  is  the  binary  repre¬ 
sentation  of  its  location  in  the  stage.  Each  link  in  each  level 
is  named  by  a  code  word  of  £+1  binary  bits,  PjjP^  ]_***Po» 
is  coded  according  to  the  following  scheme:  The  first  £  left 
most  bits,  PjP£  j...Pj,  are  the  same  as  the  binary  representation 
of  the  switching  element  to  which  the  link  is  connected  on  one 
of  its  two  right  terminals  (or  left  terminals  for  the  case  of 
level  0);  the  last  bit,  p^,  is  equal  to  0  if  the  link  is  con¬ 
nected  to  an  upper  terminal  of  the  switching  element  and 
Pq  is  equal  to  1  if  the  link  is  connected  to  a  lower  termi¬ 
nal.  For  an  example  of  the  binary  representation  of  the  physical 
names  of  the  switching  elements  and  the  links,  see  Fig.  3.3. 
Throughout  the  rest  of  this  chapter  the  binary  representations 
of  physical  names  of  a  switching  element  in  stage  i  and  a  link 
in  level  i  are  thus  assigned  (PgP£_i*  • and  ^Pslp£-1*  ‘  *p0^ i’ 
respectively.  In  the  baseline  network  the  physical  name  is 
also  used  as  its  logical  name.  However  logical  names  other  than 
physical  names  will  be  developed  in  the  latter  sections  for  other 
networks . 

The  topology  describing  rules  of  the  baseline  network  are 
defined  by 


®i^P£P£-l"  ,pi^i  1 


(p£’ * ,p£-i+l U  P£-i- ' •p2)i+l’ 


for  link  (P^P^*  •  -Pj  »  0  -  1  <  (3.1) 

and 

6i^P£P£-l"*Pl)i^  ”  (p£‘ •-p£-i+l  1  p£-i"'p2)i+l  ’ 

for  link  (PfcP£_j/  •  *PA  *■)  i+1>  0  -  1  <  *-  •  (3.2) 
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B.  Equivalent  Networks 

Some  equivalent  relationships  among  networks  have  been 
described  in  the  literature  [19,36,45].  However  these  descrip¬ 
tions  have  not  formally  been  proven.  Some  analysis  techniques 
and  partial  comparative  study  also  appear  in  the  literature 
[48-50],  In  this  subsection  an  equivalent  relationship  will  be 
defined  and  will  be  used  as  a  parameter  for  evaluating  other 
multistage  interconnection  networks. 

Let  {a?,  a!  I  0  f  i  <  i]  and  {3?,  I  0  5  i  <  i)  be  two  sets 
i  i  l  i 

of  topology  describing  rules  of  two  multistage  interconnection 
networks,  N^  and  respectively.  Network  N^  is  topologically 
equivalent  to  network  if  there  is  a  one-to-one  and  onto 


mapping  rule,  y  , 

on  (PjP£_-j_*  •  •  Pj_)  ±  such  that 

3iYi[(p£p£-r 

••PlV  =  Yi+lai[(pi£p£-l---pl}i]  • 

(3.3) 

and 

3iYi ^ (p£P£-l ' 

*  '  pl>  i 1  =  Yi+lai  ^P£P£-1‘  ’  'Pl^i^  ’ 

(3.4) 

for  0  M  <  £  .  If  two  networks  are  topologically  equivalent, 
we  also  say  that  they  show  an  isomorphic  topology.  We  use  the 
image  of  as  a  logical  name,  (b^bj,  ^...b^)^,  and  denote  the 
relation  as  (bgb^,. . .b^>  =  y [ (P£P£_1 • • • P^ ± 1 •  0n  the  right 

hand  side  of  Eq.  (3.3),  a^[(p^p^  is  tlie  physical  name 

of  the  switching  element  in  stage  i+1  which  has  link 
(PfPj.  i-,,Pi®^i+i  as  a  communication  path  and 

Yi+iai^P£P£  l-’‘Pl°i^  is  the  l°8ical  nan>e  this  switching 
element.  On  the  left  hand  side  of  Eq.  (3.3),  t (P£P^_^ • • • P^) ^ 1 
is  the  logical  name  of  the  switching  element  in  stage  i  which 
has  link  (p^p^  i’-'pi*^i+l  as  a  communicat^on  Path.  Similar 
arguments  can  be  made  for  Eq.  (3.4).  Hence,  Eqs.  (3.3)  and  (3.4) 
just  imply  a  condition  that  there  exists  a  logical  name  scheme 
for  network  such  that  the  connectivities  of  the  interconnection 
paths  labelled  with  logical  names  in  network  can  be  described 
by  the  topology  describing  rules  of  network  N^. 

The  following  theorems  on  the  isomorphic  topology  are  proven 
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by  showing  that  Eq.  (3.3)  and  Eq.  (3.4)  hold.  In  each  proof  we 
also  show  an  example  network  labelled  with  logical  names. 

Theorem  3.1:  The  regular  SW  banyan  network  with  S=F=2 
or  the  indirect  binary  n-cube  network  defined  by 

a?l(p«,Pji-i***pi)i1  *  (pr ••pi+20pi,',pi)i+i’ 

for  link  (P^P^*- -Pj  0  -  1  <  *■'  (3-5) 

and 

ail(ptp£-i"*pi)i1  “  <pr--pi+2lpi-”pi)i+i’ 

for  link  (P^P^** -Pj  D1+1»  0  -  1  <  (3.6) 

is  topologically  equivalent  to  the  baseline  network. 


Proof :  The  following  mapping  rule,  ,  is  used  to  show  the 
equivalence , 


Yi 1  (p£pjl-l' 


Vi1 


<Pi 


,pi  p£','pi+l,i* 


for  0  f  i  <  £. 


(3.7) 


It  can  be  seen  that  the  mapping  rule  provides  a  one-to-one  and 
onto  relationship  between  the  physical  and  logical  names.  The 
logical  name  assignment,  (b^b^.  •  =  Yi^p£pJl-l*  ‘  'pl^i  on 

a  regular  SW  banyan  network  with  S=F=2  or  an  indirect  binary 
n-cube  network  is  shown  in  Fig.  3.4. 

From  Eqs.  (3.1),  (3.5)  and  (3.7)  we  have 


*i+lai^pJpJt-r  '  *PlV 


'Yi+l[(p 


V  ’  >Pi+2 °  pi‘ 


‘P^i+11 


and 


(p1...pi0pr..pi+2)i+1, 


6iYi[(p£pji-r  •  -^i1 "  B?[(pr •  -pi  pr  •  -Wi1 


(3.8) 


=  (P].- • 'pi  0  p£’ * ’pi+2^i+1  *  ^3‘9^ 

for  0  5  i  <  JL  By  Eqs.  (3.8)  and  (3.9)  we  show  that  Eq.  (3.3) 
holds.  Similarly,  using  Eqs.  (3.2),  (3.6)  and  (3.7)  we  can  also 
show  that  Eq.  (3.4)  holds.  Q.E.D. 
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3.4  A  banyan  (S»F=2) ,  or  indirect  binary 
n-cube  network  structure  with  new 
configuration. 


I 


and 


Theorem  3.2:  The  modified  data  manipulator  defined  by 

<V(p£P£-l",pl)i1  =  ^p£'  ‘  'p£-i+l  0  p£-i-l'  *  ’Pl^i+1’ 

for  link  (P^P^j*  •  °)i+1*  0  i  i  <  £,  (3.10) 

ai  [  (p«.p«.-l' '  * pl) i  1  =  (p£---p£-i+l  lpJt-i-l* --P^H-l’ 

for  link  (P^P^*  •  •  PL  D 1+1  >  0  f  i  <  £,  (3.11) 


is  topologically  equivalent  to  the  baseline  network. 

Proof :  The  following  mapping  rule,  ,  is  used  to  show  the 
equivalence , 


V^^-r^Vi1  =  (p£-"p£-i+l  pi* '  *pjj,_i)i» 

for  0  5  i  5  i,  (3.12) 

It  can  be  seen  that  the  mapping  rule  is  one-to-one  and  onto.  The 
logical  name  assignment  on  a  modified  data  manipulator  of  N=16 
is  shown  in  Fig.  3.5. 

From  Eqs.  (3.1),  (3.10)  and  (3.12)  we  have 


Yi+laiI(p£p£-l'  •  'Vi1  =  Yi+lf(pr  •  ,p£-i+l  0  pJt-i-l‘ '  -Pl^i+l1 


and 


=  (Pr • -P£_i+1 0  Pj/ • -p£-i-l^i+l> 


6iYit(p£P£-l‘  *  ,pl*J  *  Bi  t(p£‘  •  ' p£-i+l  Pl*  '•p£-i)i1 


(3.13) 


^p£‘ ' -p£-i+l  0  pl* '  ’p£-i-l\+l  * 


for  0  5  i  <  £.  By  Eqs.  (3.13)  and  (3.14)  we  show  that  Eq.  (3.3) 
holds.  Similarly,  using  Eqs.  (3.2),  (3.11)  and  (3.12),  we  can 
also  show  that  Eq.  (3.4)  holds.  Q.E.D. 


65 


14 

15 


7 


7 


7 


7 


Fig.  3. 


5  A  modified  data  manipulator 
with  configuration. 
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Theorem  3.3:  The  flip  network  defined  by 

ai^P£P£-l'  ‘  'Pl^i^  =  P£P£-1‘  '  '  P2^  i+1  ’ 

for  link  (P£p£_]/”Pi  °)i+1>  0  f  i  <  Jl,  (3.15) 

and 

^'VM-'Vi1  =  (1  P£P£-1‘  *  *P2)i+l’ 

for  link  (P£P£_1"’P1  l)i+1*  0  -  1  <  (3.16) 

is  topologically  equivalent  to  the  baseline  network. 

Proof :  The  following  mapping  rule,  ,  is  used  to  show  the 
equivalence , 

Yi^(p£p£-1‘  "P1>J  =  (p£-i+l*”P£P£-i'”Pl)i’ 

for  0  5  i  <  £.  (3.17) 

It  can  be  seen  that  the  mapping  rule  is  one-to-one  and  onto. 

The  logical  name  assignment  on  a  flip  network  of  N  =  16  is  shown 
in  Fig.  3.6.  From  Eqs.  (3.1),  (3.15)  and  (3.17),  we  have 

W^(p£p£-r"piV  =  y1+1uo  P£P£.r--p2>i+^ 

(p£-i+l"-P£  °  P£-i“'P2)i+l’ 

(3.18) 

ei[(p£-i+r--p£p£-i---pi)i] 

(p£-i+l"'P£  °  P£-i ’ '  *P2^ i+1  ’ 

(3.19) 

for  0  5  i  <  £.  By  Eqs.  (3.18)  and  (3.19)  we  show  that  Eq.  (3.3) 
holds.  Similarly,  using  Eqs.  (3.2),  (3.16)  and  (3.17)  we  can 
also  show  that  Eq.  (3.4)  holds.  Q.E.D. 


and 


eiV(p£p£-r 


•piV 


67 


Theorem  3. A:  The  omega  network  defined  by 

for  link  <P£PA_1**-P10)1+1,  0  i  i  <  £,  (3.20) 


and 


ait(p2p2-l'  -  ,pl)i1  =  (p£-lp£-2‘  ‘  ’Pi  1)i+i» 

for  link  (P£P£_1...P11)1+1,  0  5  i  <  £, 

is  topologically  equivalent  to  the  baseline  network. 


(3.21) 


Proof:  The  following  mapping  rule,  y  is  used  to  show  the 
equivalence , 

Yil(¥H,,,pl)i1  =  (pi---pi  Pi+1’  •  •P£)i 

for  0  f  i  <  £.  (3.22) 

It  can  be  seen  that  the  mapping  rule  is  one-to-one  and  onto.  The* 
logical  name  assignment  on  an  omega  network  of  N=16  is  shown  in 
Fig.  3.7. 

From  Eqs .  (3.1),  (3.20)  and  (3.22),  we  have 


Yi+Iai^(p£p£-1‘ '  *pl*i^  =  Yi+l[(p£-lP£-2*  “P1  0)i+l] 


and 


(pi‘ * ’P1 °  Pi+1*  * ’P£-l)i+l’ 


BJYiUp4p£-l"*pl)i1  =  6it(pi---pl  pi+l"-pZ)i] 


(3.23) 


=  (Pj- •  -P-,^  0  Pi+1*  •  -Pjl-pi+i’ 


(3.24) 


for  0  5  i  <  £.  By  Eqs.  (3.23)  and  (3.24)  we  show  that  Eq.  (3.3) 
holds.  Similarly,  using  Eqs.  (3.2),  (3.21)  and  (3.22)  we  can 
also  show  that  Eq,  (3,4)  holds.  Q,E,D, 
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Fig.  3.7  An  omega  network  structure 
with  new  configuration. 
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Theorem  3.5:  The  reverse  baseline  network  defined  by 


ai^p£p£-l‘ '  ”pl^i^  "  (pr*‘pi+2  Pi'”Pl0)i+l  ’ 

for  link  ^P^*  • -Pj.  0  f  i  <  l,  (3.25) 

and 

ail(pjLpJL-i---pi)i1  “  (pr--pi+2  pi,,,pl  1)i+l’ 

for  link  (P£Pjl_1"  •  Px  !>1+1  *  0  f  i  <  1,  (3.26) 

is  topologically  equivalent  to  the  baseline  network. 


Proof :  The  following  mapping  rule,  is  used  to  show  the 
equivalence , 

Yit(p£p£_l- • •pi)il  -  (Pj-'-Pj  P£---Pi+i)i. 

for  0  f  i  <  L  (3.27) 

It  can  be  seen  that  the  mapping  rule  is  one-to-one  and  onto. 

The  logical  name  assignment  on  a  reverse  baseline  network  of 
N  »  16  is  shown  in  Fig.  3.8. 

From  Eqs.  (3.1),  (3.25)  and  (3.27)  we  have 

Via?((lVii-i-'-p£-i)i1  ‘  W(pr--pi+2  V--pi°W 


(pj . . .p  0  p0. . • p . , ~ . 


(3.28) 


and 


t  (p  J£P£_1*  ’  *pi>il  *  6°  t  (P±  •  *  *  Px  P£--'Pi+l^i^ 
=  (p4--.pn  0  P....P,.,). 


(3.29) 


'i"'*'lw  ••'i+2'i+l’ 

for  0  5  i  <  £.  By  Eqs.  (3.28)  and  (3.29)  we  show  that  Eq.  (3.3) 
holds.  Similarly,  using  Eqs.  (3.2),  (3.26)  and  (3.27)  we  can 
also  show  that  Eq.  (3.4)  holds.  Q.E.D. 


The  networks  described  in  Theorems  3. 1-3.5  and  any  other 
similar  networks  form  a  topologically  equivalent  class  of  multi¬ 
stage  interconnection  networks.  The  proofs  of  Theorems  3. 1-3. 5 
also  provide  rules,  Eq.  (3.7),  (3.12),  (3.17),  (3.22),  and  (3.27) 
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n  n 


Fig.  3.8  A  reverse  baseline  network 
with  configuration. 
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V 


for  the  logical  name  assignment  on  the  switching  elements.  The 
logical  name  of  each  link  in  the  network  can  be  obtained  from 
the  logical  name  of  the  adjacent  switching  element  according 
to  the  rules  set  up  in  Subsection  3.1. A. 

Corollary  3.1:  If  network  is  shown  to  be  topologically 

equivalent  to  network  by  using  the  one-to-one  and  onto  mapping 

-1 

rule,  Yi,  (i.e.,  ,  then  . 

The  fact  of  Corollary  1  is  obvious  since  y^  is  one-to-one 
and  onto  and  hence  y^  i  exists. 

Corollary  3.2:  If  network  is  topologically  equivalent 
to  the  baseline  network  and  the  image  of  its  mapping  rule  is 
used  as  the  logical  name,  we  can  obtain  the  baseline  network 
structure  from  that  of  network  by  rearranging  the  switching 
elements  in  each  stage  in  the  ascending  order  of  the  logical  name. 

The  corollary  follows  from  the  fact  that  the  interconnection 
paths  between  switching  elements  labelled  with  the  logical  name 
in  network  can  be  described  by  the  topology  describing  rules 
of  the  baseline  network.  Thus  we  can  compute  the  routing  infor¬ 
mation  of  the  baseline  network  from  the  indirect  binary  n-cube 
network,  the  regular  SW  banyan  network  with  S=F=2,  the  modified 
data  manipulator,  the  flip  network  or  the  omega  network. 


Corollary  3.3:  The  routing  information  of  the  indirect 
binary  n-cube  network,  the  regular  SW  banyan  network  with  S=F=2, 
the  modified  data  manipulator,  the  flip  network  and  the  omega 
network  can  be  computed  from  the  baseline  network. 

This  corollary  is  an  immediate  result  of  Corollaries  3.1 
and  3.2. 


Corollary  3. A:  If  N 


and  N^- 


6iYi 

>N3  then  Nx - »N3. 


Proof :  Assume  the  topology  describing  rules  of  N^,  Nj 
and  N3  are  {a^,  |  0  f  if  1} ,  {$*?,  0^  |  0  f  i  5  X.}  and 

{^i*  ^i  I  0  -  1  anc*  che  logical  names  of  switching  elements 

in  N3  and  are  (a^a^_  ^. . .  a^)  .  and  (b^b^. .  .b^)  ^ ,  respectively. 
By  the  definitions,  we  have 


(3.30) 


^i'l  i  [  1  ' 


Vi1  “  Yi+lV(a£a£- 


1 . . . ai> i ] 


and 


Vi 


'  (b£.b£- 


1-Vi1  - 


6i+lBi[(b£b£-l' 


for  0  <  i  <  £  and  j  =  0  or  1. 
From  Eq.  (3.31),  we  have 


ViYi1(a£a£-l‘ 


'Vi1  =  6i+AV(V£-l' 


■Vi1 


(3.31) 


(3.32) 


for  0  <  i  <  £  and  j  =  0  or  1. 

Substituting  Eq .  (3.30)  into  Eq.  (3.32)  we  have 

^±6iYi  l  (a£aj2-l -  ‘  ‘Vi1  =  6i+lYi+lV(a£a£-l' 


■Vi1  * 


(3.33) 


for  0  5  i  <  £  and  j  =  0  or  1. 

Eq.  (3.33)  shows  that  and  are  topologically  equivalent. 

Q.E.D. 


Using  the  symmetrical  and  transitive  properties  which  are 
shown  in  Corollaries  3.1  and  3. A,  respectively,  we  can  describe 
the  following  corollary. 


Corollary  3.5:  The  indirect  binary  n-cube  network,  the 
regular  SW  banyan  network  with  S=F=2,  the  modified  data  manipu¬ 
lator,  the  flip  network,  the  omega  network,  the  reverse  baseline 
network,  and  the  baseline  network  are  all  topologically  equiva¬ 
lent,  and  consequently  they  can  share  the  same  routing  infor¬ 
mation  for  setting  up  the  connection  paths. 

3.2  Routing  Techniques 

In  this  section  we  shall  discuss  some  routing  techniques  for  the 
class  of  the  multistage  interconnection  networks.  Overall,  these 
techniques  can  be  organized  into  a  routing  procedure  which  is  called 
the  binary  tree  coding  method.  The  binary  tree  coding  method  uses 
a  labelling  scheme  to  facilitate  a  simple  routing  algorithm  according 
to  the  concept  of  the  reducible  sets  [29].  A  destination  tag  routing 
method  proposed  for  the  omega  network  [35,36]  shows  an  equivalent 
concept  of  the  reducible  sets.  However,  the  original  configuration 
of  the  omega  network  restricts  the  destination  tag  routing  method  in 
the  one-way  communications  from  a  set  of  inputs  to  a  set  of  outputs. 


i 
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The  binary  tree  coding  method  can  result  in  the  same  connection  path 
no  matter  which  side  of  the  terminal  is  chosen  as  input  side  and  the 
other  as  output  side  so  that  no  distinction  needs  to  be  made  between 
the  inputs  and  the  outputs. 

A.  Labelling  Scheme  for  the  Terminal  Link 

The  label  assigned  to  a  terminal  link  can  be  considered 
as  the  address  of  the  processing  unit  attached  to  that  terminal 
link.  The  labelling  scheme  for  the  terminal  link  has  been  shown 
in  the  logical  name  assignment  in  the  previous  section.  However, 
we  will  describe  a  short  cut  scheme  which  can  be  used  to  label 
the  terminal  link  without  going  into  the  mapping  rules.  A  binary 
tree  can  be  formed  by  choosing  any  one  of  the  switching  elements 
in  stage  0  as  the  root  and  iteratively  considering  the  adjacent 
switching  elements  in  the  next  stage  as  the  nodes  of  the  binary 
tree.  There  are  two  outgoing  links  from  the  root  and  every 
node  in  the  binary  tree.  The  label  of  each  terminal  link  on 
Side  2  can  be  obtained  by  assigning  weight  0  for  the  upper  out¬ 
going  link,  and  1  for  the  lower  one  and  concatenating  the  weight 
along  the  path  from  the  root  to  the  terminal  link.  There  are 
N  binary  trees  which  can  be  formed  for  labelling  purposes  and 
each  tree  results  in  the  same  labels.  Fig.  3.9(a)  shows  an 
example  for  an  omega  network.  For  labelling  terminal  links  on 
Side  1,  a  binary  tree  can  be  similarly  formed  by  using  one  of 
the  switching  elements  in  the  right  most  stage  as  the  root  (see 
Fig.  3.9(b)). 

B.  Routing  Algorithm 

A  simple  algorithm  follows  from  the  binary  coding  of  the 
terminal  links.  In  the  algorithm  each  terminal  link  is  assigned 
to  a  binary  tree  using  the  adjacent  switching  element  as  the  root. 
For  each  connection  request  from  the  source  terminal  link  to  the 
destination  link(s),  the  routing  algorithm  sets  up  a  subtree  of 
the  binary  tree  assigned  to  the  source  terminal  link  according 
to  the  binary  representations  of  the  destination  labels.  For 
a  simple  demonstration  we  first  consider  the  one-to-one  connection 


Fig.  3.9  Binary  tree  coding  of  omega  network 
(a)  Right  side,  (b)  Left  side. 


request.  Let  source  terminal  link  A  labelled  by  a^a^, 
on  Side  1  be  connected  to  destination  terminal  link  Z  labelled 
by  z£2£_3‘*'zq  on  Side  2.  Starting  at  A,  the  first  node  (root 
of  the  tree)  to  which  A  is  connected  is  set  to  switch  A  to  the 
upper  link  if  z^  -  0  or  the  lower  link  if  z^  ■  1.  The  second 
node  in  the  path  is  again  set  to  switch  A  to  the  upper  link  if 
Z£_^  *  0  or  the  lower  link  if  z^  *  1.  This  scheme  is  con¬ 
tinued  until  we  get  the  proper  destination.  The  path  connected 
is  one  part  of  the  binary  tree  assigned  to  source  A.  An  example 
is  shown  by  path  1  in  Fig.  3.10.  If  we  consider  Z  as  the  source 
terminal  link  and  A  as  the  destination  terminal  link,  the  same 
procedure  will  lead  us  to  choose  the  same  path.  At  this  point, 
properties  of  the  completeness  and  homogeneity  of  the  routing 
algorithm  will  be  proven. 

Theorem  3.6:  Completeness:  The  binary  tree  coding  method 
can  set  up  any  mapping  connection  from  one  terminal  on  one  side 
of  terminals  to  another  terminal  of  the  other  side.  Homogeneity: 
The  binary  tree  coding  method  will  lead  to  the  same  path  between 
these  two  terminals  no  matter  which  end  terminal  is  chosen  as 
the  source  terminal  so  that  no  distinction  needs  to  be  made 
between  the  inputs  and  the  outputs. 

Proof :  Completeness:  Since  the  binary  representation  of  a 
destination  terminal  in  both  sides  is  the  same  as  the  code  word 
formed  by  concatenating  the  weight  of  the  link  in  the  path  from  the 
source  terminal  to  the  destination  terminal,  we  can  see  that  any 
source  terminal  on  one  side  can  be  connected  to  an  arbitrary  termi¬ 
nal  on  the  other  side  by  using  the  routing  algorithm.  Hence,  the 
routing  algorithm  can  connect  the  terminal  pair  specified  in  any 
connection  request.  Homogeneity:  The  homogeneity  can  be  proven  by 
showing  that  the  two  sets  of  the  switching  elements  respectively  in 
the  two  paths  set  up  in  opposite  directions  are  identical.  Assume 
again  a  source  terminal  A  ■  a£a£  i‘*'ao  on  s*de  1  is  t0  be 
connected  to  a  destination  terminal  Z  ■  z£z£_i'**zg  on  Side  2. 

From  Eqs.  (3.1)  and  (3.2)  we  can  see  that  the  first  switching 
element  in  the  path  from  A  to  Z  is  t*ie  second  one 

is  (z^a^a^j. .  .a2)1 ,  and  the  third  one  is  (z^z^a^a^. .  .a  )  . 
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In  general,  the  set  of  the  switching  elements  which  are  in  the 
connected  path  is 

51  ”  *(zr  ' ' zJl-i+la£a£-l*  •  ^i+l^i  I  0  "  1  "  ^  •  (3.34) 

Similarly,  the  topology  describing  rules,  Eqs.  (3.25)  and  (3.26), 
of  the  reverse  baseline  network  can  be  used  to  compute  the  set 
of  in-path  switching  elements  if  we  choose  Z  as  the  source  and 
A  as  the  destination.  Considering  Z  is  on  Side  1  of  the  reverse 
baseline  network,  we  can  see  that  the  first  switching  element  is 
(Zj.z^_^.  . .  z-^)q  ,  the  second  one  is  (z^z^  \' ' '  z *))  1'  anc^ 
one  is  (z^Zj.  ^ . .  .  z^a^a^^)  ^ .  In  general,  the  set  of  in-path 
switching  elements  becomes 

52  =  ((Z£Z£_1- • •Zj+1a£a£_1- • I  0  -  j  -  A).  (3.35) 

Since,  in  the  baseline  network,  j  =  £-i,  we  have  S^  =  S2  by 
Eqs.  (3.34)  and  (3.35).  This  result  shows  that  the  two  sets  of 
the  switcning  elements  respectively  in  the  two  paths  set  up  in 
opposite  directions  are  identical.  Q.E.D. 

The  one-to-one  connection  request  is  considered  to  be  a 
special  case  of  the  one-to-many  connection  request.  For  a 
one-to-many  connection  request  there  are  as  many  source- 
destination  pairs  as  the  number  of  destination  terminals  speci¬ 
fied  in  the  request.  The  switching  element  set  and  the  link 
set  of  the  subtree  for  a  one-to-many  connection  request  can 
be  obtained  by  unioning  respective  sets  of  each  individual 
source-destination  path.  An  example  is  shown  in  path  2,  in 
Fig.  3*10,  in  which  a  subtree  is  set  up  for  the  one-to-two 
connection  request  of  source-destination  pairs  from  terminal  13 
on  Side  2  to  terminal  3  and  terminal  5  on  Side  1. 

C.  Conflict  Resolution 

Since  all  networks  in  the  class  of  multistage  inter¬ 
connection  networks  are  of  blocking  type,  an  effort  of  restruc¬ 
turing  and  recompiling  the  computation  algorithms  into  algorithms 
which  fully  utilize  the  network  connectivities  can  enhance  the 
system  performance.  However,  not  all  computation  algorithms 
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can  be  restructured  and  recompiled  into  fully  utilizing  algo¬ 
rithms.  A  conflict  resolution  algorithm  is  necessary.  The 
sharing  of  a  common  link  by  two  or  more  independent  subtrees  is 
called  a  conflict .  The  algorithm  detects  any  conflicts  and 
resolves  the  conflicts  by  deferring  some  connection  requests  in 
the  given  request  set  so  that  all  the  connection  requests  that 
remain  show  no  conflicts.  Before  we  can  detect  the  conflicts, 
we  should  compute  the  set  of  links  which  must  be  connected  in 
a  subtree  for  a  connection  request.  In  the  proof  of  Theorem  3.6 
we  have  shown,  in  Eq.  (3.34),  that  the  in-path  switching  element 
in  stage  i  for  the  mapping  from  a^a^^.-.a^  on  Side  1  to 
Z£Z£  r • -zo  on  ^  can  be  expressed  as  (z^...z^  i+^a^. . . ^ • 

Hence  the  in-path  link  in  level  i+1  can  be  expressed  as 
(z....z„  . , ,a. . . . a. , , z„  We  can  also  have  another 

expression  to  count  the  links  for  the  mapping  from  z^z^  l'’,z0 

to  a.a„  ....a..  But  it  turns  out  that  the  two  expressions  can 
x.  Ji,—  i  U 

lead  to  the  same  result.  Without  losing  any  generality,  we  will 
work  on  the  former  expression  designed  for  the  connection 
requests  from  Side  1  to  Side  2.  For  the  sake  of  clarity  the 
binary  representation  for  the  links  are  converted  into  decimal 
numbers.  For  example,  the  ordered  set  of  links  for  the  mapping 
shown  in  path  1  in  Fig.  3.10  is  expressed  as  follows: 

1  1  0  0\  /l2  \ 

0  10  lj\s  )-  {12.12.7,6,5}. 

Now  we  are  able  to  detect  the  conflicts.  We  shall  demonstrate 
the  scheme  by  an  example  which  was  used  earlier  by  Opferman  and 
Tsao-Wu  [29].  It  contains  15  connection  requests  except  the 
one  from  source  0: 

p  /  1  2  3  4  5  6  7  8  9  10  11  12  13  14  15 

111  15  4  2  6  1  7  5  8  9  12  14  3  13  10 

The  conflicts  for  request  set  P  are  shown  in  Table  3.1.  In 

this  example,  there  are  conflicts  at  some  links  of  level  1,  2 

and  3,  and  there  is  no  conflict  in  level  4.  The  entries  of  the 
conflicts  table  are  filled  in  this  way.  If  an  i*"^  link  set 
(row)  contains  a  conflict  link  (column)  then  the  i-j  entry 


Table  3.1  A  Conflict  Table. 
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of  the  table  is  filled  with  an  X.  Otherwise,  it  is  left  unfilled. 
In  the  conflict  table,  each  column  has  at  least  two  X's.  The 
conflicts  resolution  problem  then  becomes  to  choose  a  minimal  or 
nearly  minimal  deferred  set  of  rows  such  that  after  deleting 
those  chosen  rows  each  column  has  one  and  only  one  X.  There  are 
many  ways  to  choose  the  deferred  set.  We  shall  show  a  possible 
way  in  the  conflict  table.  First,  we  can  weigh  each  link  set 
by  adding  the  number  of  X's  on  that  link  set  row  and  the  number 
of  X's  on  the  columns  in  which  the  link  set  being  considered 
has  an  X.  For  example,  there  are  three  X's  on  link  set  row 
{5, 4, 3, 5, 6},  which  indicates  that  the  conflicts  occur  at  link  4 
of  level  1,  link  3  of  level  2,  and  link  5  of  level  3.  As  shown 
in  Table  3.1,  there  is  another  X  on  each  column  of  these  three 
conflict  links.  Hence  the  weight  of  row  {5, 4, 3, 5, 6}  is  equal 
to  6.  Then  we  can  choose  the  link  set  with  the  highest  weight 
as  one  member  of  the  deferred  set,  mark  the  chosen  one  with  a  / 
and  delete  entries  in  that  row.  In  Table  3.1  the  link  ordered 
set  of  {5, 4, 3, 3, 6},  {7, 6, 3, 5, 7},  {10,11,12,10,9},  and  {14,15, 
15,14,13}  happen  to  have  the  same  highest  weight,  6.  We  choose 
{5, 4, 3, 5, 6}  as  the  one  to  be  deferred,  mark  it  and  delete  the 
entries  in  that  row.  Now  a  reduced  conflict  table  can  be  con¬ 
structed  by  deleting  all  the  columns  with  a  single  X.  In  the 
reduced  table,  Table  3.2,  columns  labelled  with  4  in  level  1, 
with  3  in  level  2,  and  with  5  in  level  3  have  been  deleted  and 
{5, 4, 3, 5, 6}  has  been  chosen  to  be  deferred.  The  same  cycle  can 
be  repeated  on  the  reduced  table  until  there  is  no  conflict 
column.  The  link  sets  marked  with  •J  form  a  deferred  set.  The 
link  sets  other  than  those  in  the  deferred  set  are  conflict-free 
and  can  be  passed  by  the  network.  Table  3.3  shows  the  result  of 
the  conflict  resolution  for  the  example.  There  are  four 
requests  that  should  be  deferred  in  the  example. 

3. 3  Full  Communication 

The  capability  of  full  communication  of  a  network  is  meant  to  be 
the  ability  of  the  network  to  be  able  to  connect  one  of  its  terminals 
to  other  terminals  at  either  side  of  the  network.  To  achieve  the  full 
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Table  3.2  A  Reduced  Table  of  Conflict  Resolution. 


Table  3.3  Result  of  Conflict  Resolution 


Link  Set 


Level  1 

Level  2 

Level  3 

Level  4 

4  6  11  15 

2  3  12  15 

5  10  14 

U,  1, 

8, 

9, 

11} 

{2,  3, 

9, 

13, 

15} 

{3,  2, 

1, 

4, 

4} 

{4,  4, 

2, 

1, 

2} 

^S,  4, 

3, 

5, 

6} 

/{6,  6, 

2, 

o, 

1} 

{7,  6, 

3, 

5, 

7} 

{8,  8, 

5, 

6, 

5} 

(9,  9, 

12, 

10, 

8} 

AlO.ll, 

12, 

10, 

9} 

(11,11, 

13, 

14, 

12} 

{12,13, 

15, 

15, 

14} 

{13,12, 

6, 

3, 

3} 

/{14.15, 

15, 

14, 

13} 

{15,15, 

14, 

11, 

10} 

communication  capability,  a  three-state  switch  can  be  introduced  [50] 
as  shown  in  Fig.  3.11.  The  mapping  requests  made  on  the  baseline 
network  with  the  three-state  switches  can  be  classified  into  four 
types:  (1)  Side  1  to  Side  2;  (2)  Side  2  to  Side  1;  (3)  Side  1  to 
Side  1;  (4)  Side  2  to  Side  2.  The  routing  procedure  for  the  first 
two  types  has  been  discussed  in  the  previous  section.  In  this  section 
we  only  discuss  the  remaining  two  types. 

Assume  that  the  two  terminals  A  =  a^a^,  and  ^  =  z£z£  1-,‘Z0 

are  on  the  same  side,  say  Side  1.  Define  c^c^  ^...Cq  =  a^a^  ^...a^ 
where  Q  is  a  bit-by-bit  EXCLUSIVE  OR  operation.  A 
routing  procedure  to  connect  A  and  Z  is  given  by  the  following  theorem. 


Theorem  3.7:  Assuming  c.  =  1  and  c.  =  0  for  j  >  i,  there  are 

i  1  J 

exactly  2  possible  shortest  paths  defined  to  include  states  of 

switching  elements  to  connect  A  and  Z  and  the  number  of  links  in  the 

shortest  path  is  exactly  equal  to  2(i+l). 


Proof :  Since  A  and  Z  are  on  the  same  side  of  the  network,  there 

is  at  least  one  switching  element  in  the  third-state  shown  in 
Fig.  3.11(c)  in  the  path  connecting  A  and  Z.  To  count  how  many 
paths  which  can  connect  A  and  Z,  we  can  count  the  number  of  switching 
elements  which  can  be  in  the  third-state  in  the  path.  From  Eq .  (3.34) 
the  set  of  switching  elements  in  stage  k  which  can  be  reached  from 
A  can  be  expressed  as: 


SA  '  ^(dk-ldk-2‘ ‘ ,d0  a£a£-l’ ‘ ’ 3k+l^k  I  dj  "  0  or  1» 


0  5  j  5  k-1 } . 


(3.36) 


Similarly  the  set  for  Z  is 
„k 


{(dk-ldk-2‘ 


d0  V£-l,,,zk+l)k  1  dj  =  °  °r  15 


o  f  j  5  k-i). 


(3.37) 


The  shortest  connection  path  should  be  the  one  in  which  the  only  one 

k  k 

third-state  switching  element,  T,  should  be  the  one  in  S^  and  S^  with 

maximum  k.  Since  c.  =  1  and  c.  =  0  for  j  >  i,  a. 

i  j  i 

and  a  y  z..  By  Eqs.  (3.36)  and  (3.37),  the  maximum  k  to  make  a 
11  k  k 

common  element  in  SA  and  S^  is  the  one  which  makes  k+1  =  i+1 ,  i.e,, 
k=i .  Hence 


ZH . ai+l=zi+l 


// 
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Fig.  3  .12  An  example  of  full  communication. 

(T  is  the  third-state  switching 
element  in  a  possible  path.) 
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where  d 


3 


(di-ldi-2' ' ,d0  a£a£-l* ‘ ‘ai+l^i 


0  or  1  and  0  5  j  5  i-1. 


(3.38) 


There  are  2  possible  values  for  T  since  d.  can  be  0  or  1  for 

^  3 

0  5  j  <  i-1.  So  there  are  2  possible  shortest  paths  which  can 
connect  A  and  Z.  The  number  of  links  which  connect  T  and  A  or  Z  is 
equal  to  i+1  so  that  the  length  of  the  shortest  path  is  2(i+l).  Q.E.D. 

Theorem  3.7  demonstrates  a  routing  procedure  for  the  full  communi¬ 
cation.  An  example  is  shown  in  Fig.  3.12.  Firstly,  we  compute  i  using 
an  EXCLUSIVE  OR  operation  on  the  logical  names  of  two  terminals,  A  and 
Z,  on  the  same  side,  which  should  be  connected.  In  the  example,  i  is 
equal  to  2.  Next  we  can  compute  the  set  of  the  third-state  switching 
elements  in  the  paths: 

{(di-ldi-2-‘-d0  Vn-Vi  ldj  =  °  °r  15 

0  <  j  5  i-1}.  (3.39) 

By  Eq.  (3.39),  the  set  of  the  third-state  switching  element  in  the 

example  is  { ( d ^ dQO) 2 1 =  0  or  1;  d  =  0  or  l).  Thirdly,  we  can 

compute  some  of  the  2*  possible  shortest  paths  by  using  A  and  Z  as 

the  source  terminals  and  (d^  ^d^  a£a£  i‘‘‘ai+l^i  as  t*ie  destina- 

tion  switching  element.  However,  in  the  implementation  phase  a  scheme 

should  be  set  up  to  determine  which  one  in  the  2*  possible  shortest 

2 

paths  should  be  computed.  There  are  totally  2  possible  shortest 
paths  for  connecting  A  and  Z  in  the  example.  Finally,  one  of  the 
possible  paths  can  be  chosen  by  applying  the  procedure  for  the  conflict 
resolution  as  described  in  the  previous  section.  Fig.  3.12  shows  a 
connecting  path  in  which  switching  element  (010)^  is  in  the  third-state. 

3.4  Summary 

We  have  presented  a  baseline  network  to  evaluate  the  relationships 
among  the  multistages  interconnection  networks  which  have  been  proposed 
in  the  literature.  It  is  shown  that  a  class  of  topologically  equiva¬ 
lent  multistages  interconnection  networks  can  be  obtained  by  properly 
permuting  the  switching  elements  and  associated  links  of  the  baseline 
network  within  the  same  stage.  The  class  of  topologically  equivalent 
multistages  interconnection  networks  includes  the  indirect  binary 
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n-cube  network,  the  modified  data  manipulator,  the  flip  network,  the 
omega  network,  the  regular  SW  banyan  network  with  S=F>=2,  the  reverse 
baseline  network  and  the  baseline  network. 

A  logical  name  representation  scheme  is  developed  to  configure 
this  class  of  the  topologically  equivalent  networks.  It  has  been 
shown  that  one  network  in  this  class  can  share  the  same  routing 
information  developed  for  another  network  in  this  same  class  if  these 
two  networks  use  the  same  representation  scheme. 

The  logical  name  representation  scheme  enables  a  simple  routing 
algorithm  and  the  routing  algorithms  are  proven  to  be  complete  and 
homogeneous  so  that  no  distinction  should  be  made  between  the  inputs 
and  the  outputs.  A  routing  procedure  has  been  developed  on  the  basis 
of  the  homogeneous  routing  algorithm.  Since  all  the  networks  in  the 
defined  class  are  blocking,  the  routing  procedure  includes  the  capa¬ 
bility  to  resolve  the  conflicts  by  choosing  a  deferred  set  of  mapping 
requests  according  to  some  priority  scheme. 

The  routing  procedure  can  also  be  extended  to  allow  one-to-one 
connections  between  all  pairs  of  terminals  so  that  there  is  no  need 
to  divide  the  terminals  into  two  disjoint  sets. 
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CHAPTER  4 


FAULT-DIAGNOSIS  FOR  A  CLASS 
OF  MULTISTAGE  INTERCONNECTION  NETWORKS 

The  reliable  operations  of  interconnection  networks  are  impor¬ 
tant  to  the  overall  system  performance.  Yet  there  have  been  very 
little  activities  in  investigating  the  f ault-diagnosos  of  such 
networks . 

It  is  shown,  in  Chapter  3,  that  the  routing  procedure  of  the 
multistage  interconnection  networks  can  be  developed  based  on  the 
baseline  network.  In  this  chapter  we  investigate  the  fault-detection 
and  the  fault-location  problems  of  this  baseline  network. 

The  fault-diagnosis  problem  is  approached  by  generating  suitable 
fault-detection  and  fault-location  test  sets  for  every  fault  in  the 
assumed  fault  model.  The  test  sets  are  then  trimmed  to  a  minimum  or 
nearly  minimal  sets.  In  Section  4.1  we  propose  a  fault  model  of  a 
switching  element  and  derive  a  test  set  for  every  fault  in  the  fault 
model.  The  objective  of  Sections  4.2  and  4.3  is  to  develop  a  specific 
fault-diagnosis  scheme  for  the  network  constructed  of  switching 
elements  having  direct-  and  crossed-connection  capabilities  as  shown 
in  Fig.  3.1.  The  fault-diagnosis  of  single  faults  and  the  fault 
characteristics  are  discussed  in  Section  4.2.  The  multiple  fault 
detection  problem  is  then  considered  in  Section  4.3.  The  fault 
characteristics  which  provide  a  specific  criterion  for  designing 
easily  testable  switching  elements  are  summarized  in  Section  4.4. 

4 . 1  Fault  Model  and  Test  Set  of  a  Switching  Element 
A.  Fault  Model 

A  fault  in  an  interconnection  network  can  be  located  either 
at  a  link  or  in  a  switching  element.  All  discussion  in  this 
chapter  is  confined  to  solid  logical  faults.  The  fault  located 
at  a  link  can  be  considered  to  be  one  of  line  stuck  types,  i.e., 
stuck-at-zero  (s-a-0)  or  stuck-at-one  (s-a-1) .  We  use  a  func¬ 
tional  approach  to  consider  fault  types  in  a  switching  element. 
Generally,  a  switching  element  with  two  input  lines  and  two  output 


lines  can  be  considered  as  a  2  *  2  crosspoint  switching  matrix 
which  may  have  as  many  as  16  states.  Table  4.1  shows  the  set  S 
of  the  16  states  and  the  related  symbolic  representation.  In 
our  proposed  multistage  interconnection  network,  a  switching 
element  can  only  be  in  some  of  the  16  states  by  an  implementation. 
We  denote  these  states  as  valid  states.  In  the  flip  network 
and  the  indirect  binary  n-cube  network,  the  valid  states  include 
and  S^q.  The  valid  states  in  the  omega  network  and  the 
regular  SW  banyan  network  with  F=S=2  include  S^»  S,.,  S^q,  and 
S^*  The  number  of  valid  states  which  a  switching  can  assume 
in  order  to  achieve  the  network  function  depends  on  the  capa¬ 
bility  requirement  of  the  interconnection  network.  However,  a 
faulty  switching  element  can  be  in  any  one  of  the  16  states  from 
a  given  valid  state.  Hence,  for  a  switching  element  with  n 
valid  state,  there  are  (16)n  possible  state  combinations  in  which 
the  faulty  switching  element  can  behave.  We  use  the  ordered  set 

{(s,,s„,...,s  )  Is.eS,  1  <  i  5  n}  to  describe  the  state  combi- 
i  L  n  l 

nations  and  name  each  of  the  state  combinations  a  functional 
state.  As  an  example.  Fig.  3.1  shows  a  switching  element  with 
two  valid  states,  S^q  and  S^.  Assume  the  first  valid  state  is 
and  the  second  S,. .  The  functional  states  of  switching 
element  can  be  expressed  by  a  functional  state  set  which  is  an 
inner  product  set  of  S,  S  »  S.  There  are  236  functional  states. 
The  state  combination  (S^q,S<.)  is  the  normal  functional  state  and 
the  other  255  state  combinations  are  faulty  functional  states 
of  the  switching  element  shown  in  Fig.  3.1. 

B.  Test  Set 

A  test  set  should  be  developed  for  detecting  every  fault 
in  the  fault  model  described  above.  Faults  to  be  detected  and 
tests  for  detecting  them  are  listed  in  Table  4.2  for  a  switching 
element  in  valid  state  S^.  In  Table  4.2  the  detection  of  the 
link  stuck  fault  is  described  in  Part  I.  The  superscripts  of 
the  link  labels  indicate  whether  the  fault  causes  the  link  stuck 
at  0  or  1.  For  example,  in  the  first  row,  we  can  see  that  if 
we  apply  an  input  (x^.x^)  =  (1,0)  to  the  switching  element  in 
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Table  4.1  Set  of  the  16  States  and  the  Related  Symbolic 
Representation  of  a  2  *  2  Switching  Element  . 


valid  state  S^,  the  normal  output  will  be  (x^.x^)  *  (1,0)  and 

the  fault,  x°  or  x°,  of  x^  or  x^  sticking  at  0  will  cause  output 

to  be  (x^.x^)  =  (0,0).  We  then  say  that  the  input  (x^,x^)  * 

(1,0)  can  detect  the  fault,  x°  or  x° ,  of  the  switching  element 

in  valid  state  S  .  The  detection  of  switching  element  faults 
10 

is  described  in  Part  II.  For  a  switching  element  stuck  in  S,., 
S^q-Sj.,  (see  row  S^-S^.  of  Part  II  of  Table  4.2),  if  we  apply 
input  (x^,X2)  =  (0,1),  the  faulty  output  will  be  (x^.j^)  =  (1,0) 
which  is  different  from  the  normal  output  (x  .j^)  =  (0,1).  In 
Table  4.2,  means  logically  undefined  output  and  "0"  means 

logically  erroneous  output  where  0  and  1  are  the  simultaneous 
inputs.  The  output  values  of  and  "4>"  depend  on  the  circuit 

implementation  of  the  switching  element.  However,  an  arbitrary 
assignment  of  0  or  1  to  or  "4>"  would  not  affect  the  differ¬ 
entiation  between  the  normal  output  and  the  faulty  output.  Hence 
whether  we  can  easily  design  an  equipment  to  detect  and 

would  not  disturb  our  development  of  the  test  set  for  various 
faults . 

From  Table  4.2  it  can  be  seen  that  only  two  tests  (x^,x^)  = 
(0,1)  and  (x^,x^)  =  (1,0),  are  needed  to  detect  all  faults.  The 
test  vectors  on  and  x^  are  01  and  10,  respectively.  For  an 
easy  reference  we  define  t  =  01  and  t  =  10.  The  same  conclusion 
can  be  drawn  for  a  switching  element  in  valid  state  S^.  The 
faults,  the  tc. •  inputs  and  the  test  outputs  of  are  shown  in 
Table  4.3.  Similarly,  the  above  techniques  can  also  be  extended 
to  detect  faulty  elements  in  other  networks  such  as  omega  and 
banyan  with  additional  valid  states  and 

4.2  Diagnosis  of  Single  Faults 


A.  Fault  Detection 

An  algorithm  for  deriving  efficient  test  sets  for  the  network 
will  be  presented.  The  basic  idea  is  to  establish  connection 
paths  and  to  label  each  link  in  a  path  with  t  (or  t)  such  that 
each  switching  element  in  the  network  has  its  two  input  lines 
labelled  with  the  two  test  vectors  (t  and  t) ,  respectively.  The 
connection  paths  are  established  by  putting  switching  elements 
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into  a  valid  state  to  be  tested.  Since  only  one  valid  state  of 
the  switching  element  can  be  tested  in  a  test  phase,  two  test 
phases  are  needed  for  the  switching  element  shown  in  Fig.  3.1. 

In  phase  1,  we  test  the  valid  state  shown  in  Fig.  3.1(a)  for 
all  switching  elements  in  the  network  and  in  phase  2,  we  test 
the  valid  state  shown  in  Fig.  3.1(b).  For  a  simple  demonstra¬ 
tion,  consider  a  network  with  four  terminal  links  in  each  side, 
as  shown  in  Fig.  4.1.  The  labels  on  the  input  lines  of  the 
leftmost  stage  correspond  to  the  required  test  vectors  while  the 
other  labels  indicate  the  fault-free  response  of  the  network 
to  these  test  vectors.  The  fault-free  response  of  the  network 
shown  in  Fig.  4.1  assures  that  each  one  of  the  switching  elements 
has  its  two  input  lines  labelled  with  two  different  test  vectors. 
These  two  different  test  vectors  are  exactly  the  test  vectors 
needed  to  test  each  valid  state  of  a  switching  element  (see 
Section  4.1).  These  test  vectors  appearing  on  the  input  lines 
constitute  a  test  set  which  can  efficiently  test  all  switching 
elements  in  the  network.  An  algorithm  for  generating  such  an 
efficient  test  set  for  a  network  of  size  N  is  described  as 
follows : 

Step  1:  Label  the  top  terminal  link  in  the  left  side  of  the 
network  with  test  vector  t  =  01. 

Step  2:  Assume  the  labelled  terminal  links  are  named  0,1,..., 
and  m-1  from  top  to  bottom  and  the  next  m  unlabelled 
terminal  links  are  named,  from  top  to  bottom,  m,m+l,..., 
and  2m-l,  where  1  -  m  <  N  and  m  is  in  2’s  power.  Label 
terminal  link  m+i  with  L(i)  for  0  f  i  f  m-1,  where 
L(i)  is  the  test  vector  assigned  to  terminal  link  i  and 
L(i)  is  the  complement. 

Step  3:  For  the  unlabelled  terminal  links  in  the  left  side, 
repeat  Step  2  until  all  N  terminals  are  labelled. 

The  test  set  generated  by  the  above  algorithm  is  good  for  both 
test  phases  and  an  example  is  given  in  Fig.  4.2,  which  shows 
the  fault  free  response  of  an  example  network  to  the  test  vectors 
generated  by  the  above  algorithm.  It  can  be  seen  that  to  detect 
single  faults  in  a  network  four  tests  (two  for  each  test  phase) 


ult-free  response  of  a  network  to  the  test  6et. 
)  Phase  1  test,  (b)  Phase  2  test. 
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are  necessary  and  sufficient  and  the  test  length  is  independent 
of  the  network  size.  This  statement  will  be  proven  in  a  theorem 
following  two  observations: 

Observation  1:  If  we  name  the  N  input  lines  of  stage  i 
(0  i  i  i  i  ■  log2N-l)  by  £+1  binary  bits  (P£P^_1* • •PQ)i 
according  to  the  position  order,  the  correspondence  between 

(p.P£_l* • *PQ^i  and  ^p£p£-l‘ • 'p0^0  in  the  tW°  teSt  phases  can  be 
expressed  as  follows: 

{(p£fVl'--p0)i  =  (p0Pl-*-pi-l  P£‘  ’  ‘Pi)0’  f°r  phaSe 

0  <  i  5  4,  and  (4.1) 

(p£p£-l*  *  *P0)i  =  (p0pr--pi-l  P£‘ '  'Pi)0*  f0r  phase  2’ 


0  <  i  <  1,  (4.2) 

<  i.  Some  examples  are 
shown  in  Fig.  4.3.  In  Fig.  4.3(a)  of  phase  1,  if  set  (P3P2Pipo^o 
=(0l01)o  and  (P^P^o^o  =  (100°)n’  tben  according  to  Eq.  (4.1) 


where  p^  is  the  complement  of  p^.  ,  0  _  j 


0’ 


we  have 


(1010)1  =  ^P0P3P2P1^0 ’ 
(1001)2  =  (P0P1P3P2>0’ 
(1010) 3  =  ^P0P1P2P3)0’ 
(0100)1  =  (Pop3P2PpO’ 
(0010)2  =  (PqP'PjPPo’ 


and 


(0001)  3  -  (W^V 

In  Fig.  4.3(b)  of  phase  2,  if  set  (P3P2p£po^o  =  and 

(p^p'p'pp)  =  (1110)^,  then  according  to  Eq.  (4.2)  we  have 

(ooio)1  =  (p0p3p2p1^o  » 

(oioi) 2  =  (P0P1P3P2)0- 
(oioo) 3  =  (Po^i^^o* 

( Hi  1)  1  =  ^P0P3P2P1^0  ’ 

(lOlD  2  =  (Vip3PPo’ 

and  (1001)  3  =  ('P^PjP^Ppo' 
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Observation  2:  There  are  two  kinds  of  test  vectors  (t  =  01 
and  t  =  10)  assigned  to  the  input  terminals.  Assume  that 
(PftPc.  l’*'P0^i  *s  t*ie  Pos^t^on  c°de  word  as  described  in  Obser¬ 
vation  1.  Then,  in  the  test  set  generated  by  the  algorithm,  the 
test  vector  on  terminal  (p^p^  ^..*Pq)q  C  there  is  an  even 
number  of  l's  in  Cp^p^  j...pg)g  and  test  vector  is  t  if  there 
is  an  odd  number  of  l's  in  (p^p^  ^...Pq)q.  Comparing  Fig.  A. 3(a) 
to  Fig.  4.2(a)  we  can  see  that  the  test  vector  on  terminal 
(0101)q  is  t  and  the  test  vector  on  terminal  (1000)^  is  t. 

Theorem  4.1:  Four  tests  are  necessary  and  sufficient  for 
detecting  single  faults  in  a  baseline  network  constructed  of 
switching  elements  with  two  valid  states  shown  in  Fig.  3.1. 

Proof :  The  detection  procedure  is  conducted  in  two  test 
phases.  In  each  test  phase  the  length  of  the  test  vectors  is 
equal  to  two.  Hence  the  total  number  of  tests  is  equal  to  four. 

We  shall  prove  that  these  four  tests  are  necessary  and  sufficient. 
Necessary:  The  proof  of  necessary  condition  is  trivial  since 
to  detect  a  single  fault  in  a  switching  element  or  at  related 
links,  the  minimum  number  of  tests  required  is  four.  Sufficient: 
The  sufficient  condition  can  be  proved  by  showing  that  the  test 
set  of  length  2  can  provide  each  switching  element  in  the  network 
two  test  vectors  (t  and  t)  with  which  two  input  lines  are 
labelled,  respectively,  in  each  test  phase.  Observation  2 
guarantees  that  each  switching  element  in  stage  0  has  its  two 
input  lines  labelled  with  two  test  vectors  (t  and  t) ,  respec¬ 
tively,  because  the  position  code  word  of  one  input  line  of  these 
switching  elements  contains  an  even  number  of  l's  and  the  position 
code  of  the  other  contains  an  odd  number  of  l's.  For  the 
switching  elements  in  stage  i,  i  >  0,  we  have  to  consider  some 
more  facts.  The  permutation  described  in  Observation  1  for 
phase  1  test  doesn't  change  the  number  of  l's  in  the  code  point 
(p^p^  i-*-P0V  Hence  t*ie  statement  in  Observation  2  is  also 
true  for  the  input  lines  of  stage  i,  i  >  0,  in  the  network.  This 
assures  that  each  switching  element  in  the  network  has  its  two 
input  lines  labelled  with  two  test  vectors  (t  and  t),  respectively, 
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in  phase  1  set-up.  However,  in  phase  2  set-up  we  have  a  modifi¬ 
cation.  The  permutation  described  in  Observation  1  for  phase  2 
test  could  change  the  number  of  l's  in  the  code  word 
Cp^p ^  ]p**,Pg^0"  can  ke  seen  that  if  the  stage  number  i  is 

even,  both  (P^P^*  •  -Pgig  and  <P0P1--'P1_1  P^-'P^g  have  an 
even  or  odd  number  of  l's  and  if  the  stage  number  i  is  odd, 
^P£P£-1‘ *  ‘ ^0^0  ^aS  an  even  nun,ber  °f  l's  while 

(PqP^  .  .  .  p^  j  .  . .  P^)  o  ^as  an  number  of  l's  and  vice  versa. 

Hence  we  observed  that  the  test  vector  for  (p£P£_^* • -Pg) ^  is  t 
if  the  sum  of  i  and  the  number  of  l's  in  (p^P£_^ • • ■ Pg) ^  is  even 
and  the  test  vector  is  t  if  the  sum  is  odd.  The  above  obser¬ 
vation  also  assures  that  each  switching  element  in  stage  i, 
i  >0,  in  the  network  has  its  two  input  lines  labelled  with  two 
test  vectors  (t  and  t) ,  respectively,  in  phase  2  set-up.  Q.E.D. 

B.  Fault  Location 

The  problem  of  locating  a  single  fault  can  be  partitioned 
into  two  subproblems:  one  is  to  locate  the  stuck  fault  at  a 
link  and  the  other  is  to  locate  the  fault  in  a  switching  element. 

1.  Link  stuck  fault: 

The  first  subproblem  can  easily  be  solved  due  to  the 
following  two  observations: 

Observation  3:  A  stuck  fault  at  a  link  can  cause  one 
and  only  one  faulty  output  at  an  observable  terminal  in 
each  test  phase.  Each  faulty  output  should  be  equal  to 
either  00  or  11. 

Observation  4:  Each  link  in  the  network  can  uniquely 
be  identified  by  two  paths,  one  from  phase  1  and  another 
from  phase  2. 

The  method  to  compute  the  link  set  in  a  path  can  be  found 
in  Hiapter  3.  The  test  set  derived  for  detecting  single 
faults  can  be  used  to  locate  a  single  stuck  fault  at  a  link. 
However,  the  link  stuck  fault  may  not  be  distinguishable 
from  some  switching  element  faults  which  will  be  discussed 
later.  In  spite  of  this  indistinguishability ,  there  exists 


a  one-to-one  relationship  between  a  link  stuck  fault  and  a 
faulty  output  pattern. 


Theorem  4.2:  There  is  a  one-to-one  correspondence 
between  the  link  stuck  fault  and  the  faulty  output  pattern. 
The  faulty  output  pattern  is  a  necessary  condition  of  the 
link  stuck  fault. 


Proof :  Since  there  are  l+log2N  levels  of  links  and 
each  level  contains  N  links,  the  total  number  of  link-stuck- 
fault  locations  is  equal  to  N(l+log2N).  From  Observations  3 
and  4,  a  link  stuck  fault  can  be  identified  by  using  a 
faulty  output  at  the  phase  1  test  and  another  faulty  output 
at  the  phase  2  test,  but  not  every  pair  of  faulty  outputs 
can  necessarily  pinpoint  a  link  stuck  fault.  There  are 
exactly  N(l+log2N)  pair  of  faulty  outputs,  each  of  which  is 
correspondent  to  a  link  stuck  fault.  The  correspondence  is 
described  as  follows.  The  stuck  fault  of  link 
(p^Pg  i‘"’Po^i  Can  P:*-nPo:‘-nted  by  the  phase  1  faulty  output 
at  terminal  link  <Pr  •  .P£.1+2P0Pr- -PA_i+1>  *+1  for  0  <  i  <  £+1 
or  (p^p^.  *  ‘Pji^£+l  ^°r  i  =  0  and  the  phase  2  faulty  output  at 

terminal  link  (p£.  •  *  ‘Vi+lVl  f°r  °  <  1  *  £+1 

or  (p^p^. '  'Pp^  £+1  f°r  i  =  The  fault  output  at  these  two 
terminals  should  be  equal  (either  00  or  11).  However  this 
faulty  output  pattern  is  only  a  necessary  condition  for  the 
link  stuck  fault  since  the  same  faulty  output  pattern  may 
imply  a  switching  element  fault  which  will  be  discussed 
later.  Q.E.D. 


Example :  A  network  along  with  its  test  responses  of 
both  phase  1  and  phase  2  tests  is  shown  in  Fig.  4.4.  Comparing 
the  test  outputs  to  the  fault  free  output,  we  observe  that  the 
path  of  link  set  {6, 6, 3, 5, 6}  in  the  phase  1  test  and  the  path 
of  link  set  {7, 6, 2, 0,1}  in  the  phase  2  test  lead  to  the 
faulty  output  00  of  link  (0110)^  at  the  phase  1  test  and 
(0001)^  at  the  phase  2  test.  Intersecting  the  two  link  sets, 
we  can  locate  the  fault  at  link  (0110) which  is  stuck  at 
zero. 
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2.  Switching  element  fault: 

A  switching  element  fault  can  be  the  result  of  any  one 
of  the  16  states  shown  in  Table  4.1.  Single  switching  element 
faults  in  a  network  can  result  in  several  faulty  output 
patterns.  In  terms  of  the  response  patterns  of  the  detec¬ 
tion  phases  the  faults  can  be  classified  into  four  cases  as 
follows : 

(1)  One-response  fault  -  There  is  only  one  faulty  output. 

This  faulty  output  can  be  a  terminal  output  at  either 
phase  1  test  or  phase  2  test; 

(2)  Separated  two-response  fault  -  There  are  two  faulty 
outputs.  One  of  them  is  a  terminal  output  at  phase  1 
test  and  the  other  is  a  terminal  output  at  phase  2  test ; 

(3)  Nonseparated  two-response  fault  -  There  are  two  faulty 
outputs.  But,  both  of  the  faulty  outputs  are  terminal 
outputs  at  either  phase  1  test  or  phase  2  test; 

(4)  Multiple-response  fault  -  There  are  more  than  two  faulty 
outputs . 

Each  case  will  be  considered  in  the  following  paragraphs. 

Case  1:  The  set  of  switching  elements  involved  in  a 
faulty  path  is  not  sufficient  to  locate  a  single  fault  at  the 
switching  element  level  since  we  have  to  pinpoint  exactly  one 
switching  element  in  this  set.  Additional  tests  will  be 
necessary  to  determine  the  fault  location  and  the  fault  type. 
According  to  Table  4.2  we  find  that  P  =  {S£  ,S^  ,Sg  .S^  .S^ } 

is  the  sec  of  the  faulty  state  which  has  one  faulty  output  in 
valid  states  S^q.  Thus,  if  the  functional  state  of  a  switching 
element  is  one  of  the  following:  (S^  ,S,.)  ,  (Sg  ,S,.)  , 

(Sn,S5),  (S12’S5)>  and  (^i4 ,S^) ,  we  have  only  one  faulty 
output  at  phase  1  test  and  no  faulty  output  at  phase  2  test. 
Similarly,  according  to  Table  4.3  we  can  find  that  Q 

,S^  is  the  set  of  the  faulty  state  which  has  one 

faulty  output  in  valid  state  S^,  and  any  one  of  the  following 
functional  states:  (S^q,S^)  ,  (S^q,S^)  ,  (S^Q,Sy)  ,  (S^q.S^)  * 
and  results  in  one  faulty  output  at  the  phase  2 

test  and  no  faulty  output  at  the  phase  1  test.  These  12  fault 


types  and  the  related  faulty  output  patterns  are  shown  in 
Table  4.4  which  will  be  used  to  facilitate  the  proof  of 
Theorem  4.3. 


Theorem  4.3:  The  fault  location  and  the  fault  type  of 
the  one-response  fault  can  be  determined  by  at  most 
6+2  flog2(log2N)|  or  6+2^1og2(log2N)J  tests. 

Proof :  The  proof  will  be  done  by  constructing  an 

algorithm  to  determine  the  fault  location  and  the  fault  type. 
The  algorithm  makes  use  of  the  principle  of  a  binary  search. 

Assume  that  each  stage  of  the  network  is  a  leaf  of  a 
binary  tree  in  which  each  node  has  two  incident  branches, 

L  and  R.  Starting  at  the  root,  the  algorithm  will  generally 
try  to  pinpoint  a  fault  in  one  of  the  branches  until  the 
pinpointed  faulty  branch  is  a  leaf.  In  order  to  decide  in 
which  branch,  L  or  R,  the  fault  stays,  an  experiment  is 
conducted  at  each  node  in  the  faulty  tree  path  which  is  the 
path  from  the  root  to  the  faulty  leaf.  The  experiment  is  a 
test  in  which  the  valid  state  of  switching  elements  in  L  and 
the  left  of  L  should  be  set  up  as  the  one  set  up  in  the  test 
which  shows  a  faulty  output  and  the  valid  state  of  switching 
elements  in  R  and  the  right  of  R  should  be  set  up  as  the  one 
set  up  in  the  test  which  shows  the  normal  response.  The  two 
input  vectors  in  the  experiment  are  the  same  as  those  two  at 
the  detection  phase.  If  the  response  of  the  experiment  is 
not  equal  to  the  normal  response,  R  branch  is  fault-free. 
Otherwise  L  branch  is  fault-free.  The  number  of  the  nodes  in 
the  path,  from  root  to  leaf,  of  the  tree  is  equal  to  either 
[log2(log2N) I  or  |log2(log2N)  |  where  N  is  the  number  of 

(log2N~]  is 

the  smallest  integer  which  is  greater  than  or  equal  to 
log2(log2N)  and  |log2 (log2lOj  is  the  largest  integer  which 
is  less  than  or  equal  to  log2(log2N).  Hence  we  have  to  do 
either  |Tog2  ( log2N)|  or  |log2  (log2N)j  experiments.  In 
addition,  four  tests  are  used  at  the  detection  phase  as 
described  in  Section  4. 2. A.  Thus,  the  total  number  of  tests 


t 


terminal  links  in  one  side  of  the  network,  |log2 
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Table  4.4  Faulty  Output  Pattern  In  Case  1 


Faults 

of 

Case  1 

Upper  (U)  or 

Lower  (L)  Link, 
by  Which  the 

Faulty  Switching 
Element  Sends 
the  Fault 

Test  Phase 
at  Which 
Fault 

Appears . 

Faulty  — :  (00  or  11) 
Output  00:  (00  or  11) 
Binary  Vector 
(10  or  01) 

(S2’V 

U 

1 

— 

(S3*V 

U 

1 

Binary  Vector 

(vv 

L 

1 

— 

(S11'S5> 

U 

1 

00 

(S12,S5) 

L 

1 

Binary  Vector 

<S14-S5> 

L 

1 

00 

(S10,S1) 

L 

2 

— 

<S10-S3> 

L 

2 

Binary  Vector 

<S10’V 

u 

2 

— 

(S10-S7> 

L 

2 

0C 

(S10,S12) 

U 

2 

Binary  Vector 

(S10,S13) 

U 

2 

00 

for  locating  a  single  fault  in  this  case  is  equal  to 
4+2  |log2(log2N)|  or  4+2  | log2 ( log2N)  |  . 

The  next  logical  step  is  to  determine  the  fault  type. 

As  shown  in  Table  4.4  there  are  four  kinds  of  faulty  outputs: 
01,  10,  00,  and  11.  If  the  faulty  output  is  a  binary  vector 
(01  or  10)  we  can  determine  the  fault  type  using  the  infor¬ 
mation  of  U  or  L  (U  means  that  the  faulty  switching  element 
sends  the  faulty  output  via  its  upper  link,  and  L  the  lower 
link)  and  the  test  phase  at  which  the  fault  appears.  If  the 
faulty  output  is  00  or  11,  additional  tests  should  be  made 
in  order  to  differentiate  the  faults  in  the  following  pairs: 
(S2>S5)  and  (S^.S,.);  (Sg,S,.)  and  (S^.S^);  (s10,Sl^  and 
(S ,  S  7)  ;  (S^q  ,S^)  and  (S^.S^).  In  each  pair,  one  fault 
type  has  <)>$  output  and  the  other  —  output.  Hence,  the 
purpose  of  the  additional  tests  is  to  determine  whether  the 
located  faulty  switching  element  had  <K  output  or  —  output. 
The  test  can  be  conducted  by  setting  the  whole  network  in 
the  valid  state  in  which  the  faulty  switching  element  presents 
the  faulty  output  of  00  or  11,  and  assign  the  same  test  vector 
(10  or  01)  to  the  test  input  of  the  two  paths  which  lead  to 
the  faulty  switching  element.  If  there  is  no  faulty  output 
in  this  test  then  the  faulty  switching  element  had  <t<!>  output. 
Otherwise  it  has  —  output.  Hence  to  determine  the  fault 
location  and  the  fault  type  the  total  number  of  tests  needed 
is  at  most  equal  to  6+2  |log2  ( log2N)|  or  6+2  |log2  (log2N)J. 

Q.E.D. 

Example :  The  tree  representation  and  the  test  response 
of  an  example  network  are  shown  in  Figs.  4.5(a)  and  4.5(b), 
respectively.  The  switching  element  set  in  the  faulty  path 
is  (5, 2, 3, 2).  One  of  the  switching  elements  in  the  set  is 
faulty.  However,  the  faulty  response  fails  to  provide  infor¬ 
mation  for  locating  the  fault.  Now,  we  do  an  experiment  at 
root  n  corresponding  to  the  testing  of  for  the  L  branch 

elements  and  S,.  for  the  R  branch  elements  of  the  network. 

The  set-up  and  the  experiment  results  which  contain  one  faulty 
output  are  shown  in  Fig.  4.6(a).  Since  the  faulty  output 
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Normal 

output 


Experiment 

result 


appears  at  the  phase  1  test  in  the  detection  phase  and  L 
branch  in  this  experiment  is  set  up  for  the  phase  1  test, 
we  can  then  conclude  that  R  branch  is  fault-free  and  the 
fault  stays  in  L  branch.  We  then  do  another  experiment  at 
n^ ,  which  is  shown  in  Fig.  4.6(b),  to  locate  the  fault  in 
L.  It  can  be  seen  that  the  response  of  this  experiment  is 
equal  to  the  calculated  normal  response.  Hence  branch 
is  faulty  and  branch  is  fault-free.  We  can  then  say  that 
switching  element  2  of  stage  1  is  faulty.  Since  the  faulty 
switching  element  sends  the  faulty  output  via  its  lower  link, 
the  faulty  output  appears  at  the  phase  1  test  and  the  faulty 
output  is  11  which  could  be  the  result  of  either  <J)4>  faulty 
or  —  faulty,  we  can  see  from  Table  4.4  that  the  faulty  func¬ 
tional  state  of  the  faulty  element  is  either  (S  ,S  )  or 

O  J 

(S^,S^).  The  additional  test  as  described  in  Theorem  4.3 
is  shown  in  Fig.  4.7.  If  the  test  output  of  Z  is  10  then 

the  fault  type  is  (S,.,Sr).  Otherwise  it  is  (SOISr). 

14  5  8  5 

The  number  of  tests  indicated  in  Theorem  4.3  is  actually 
an  upper  bound  of  the  number  of  tests  for  determining  the 
fault  location  and  the  fault  type  at  the  switching  element 
level.  In  some  cases  we  may  only  need  to  locate  the  fault 
at  the  module  level.  Then  the  number  of  tests  needed  is  less 
than  this  upper  bound  depending  on  the  size  of  the  modules. 

For  example,  in  the  example,  if  L  and  R  are  two  different 
modules,  only  the  tests  at  node  n  are  needed  for  locating 
the  fault  either  at  L  or  at  R. 

Case  2:  In  this  case  the  faulty  switching  element  has 
only  one  faulty  output  in  each  valid  state.  We  have  described 
in  Case  1  that  P  =  {S^  ,S^  ,Sg  ,S^  ^  .S^  ,S^ }  and  Q  =  {S^.S^.S^, 
J>7’53l2 ’5>13^  are  the  sets  of  faulty  states  which  have  only  one 
faulty  output  in  valid  states  and  ,  respectively.  The 
possible  faulty  output  combinations  of  these  two  sets  are 
depicted  in  Table  4.5  in  which  there  are  six  subcases:  A,  B, 

C,  D,  E,  and  F.  There  are  36  functional  states  in  this  case, 
which  form  the  inner  product  set  of  P  and  Q,  P  x  Q.  These 
36  functional  states  are  classified  into  six  subcases  according 


Table  4.5  Faulty  Output  Pattern  in  Case  2. 


\ 

Faulty  Outputs 

Subcase 

1 

2 

A 

01  or  10 

Binary  Vector 

01  or  10 

Binary  Vector 

B 

01  or  10 

Binary  Vector 

<f>  <P 

C 

01  or  10 

Binary  Vector 

— 

D 

<P  P 

-  - 

E 

<P  <P 

<p  $ 

F 

— 

—  -  ■  ■  ^  . .  -  -  -  . 

Table  4.6  Classification  of  the  Functional  State  in  Case  2 


to  the  faulty  output  patterns  as  shown  in  Table  4.5.  The 
classification  is  shown  in  Table  4.6  in  which  the  horizontal 
caption  is  for  the  faulty  states  of  valid  state  and  the 
vertical  for  the  faulty  states  of  valid  state  S^.  Ar  example 
of  reading  Table  4.6  is  described  below.  Suppose  is 

a  faulty  functional  state  of  (S^.S^).  The  E  at  the  inter¬ 
section  of  column  and  row  in  Table  4.6  implies  that 
the  switching  element  in  functional  state  (S^.S^)  will 
result  in  a  faulty  output  of  a  binary  vector  in  a  test  phase 
and  a  <p<p  faulty  output  in  another  test  phase  according  to 
Table  4.5.  Examples  for  the  subcases  are  shown  in  Table  4.7. 
The  examples  show  that  there  are  two  common  switching  elements 
in  the  two  faulty  paths.  One  of  these  two  common  switching 
elements  is  faulty.  Additional  test  sets  should  be  derived 
in  order  to  locate  the  fault  within  these  two  questionable 
switching  elements.  In  some  examples  not  shown  in  Table  4.7 
there  is  only  one  common  switching  element  in  the  two  faulty 
paths.  In  these  examples  the  common  switching  element  is 
either  in  the  rightmost  stage  or  in  the  leftmost  stage. 

Theorem  4.4:  The  fault  location  and  the  fault  type 
of  the  Subcase  A  fault  can  be  determined  by  at  most  8  tests, 
independent  of  the  network  size. 

Proof :  The  proof  can  be  divided  into  two  steps.  The 
first  step  develops  an  algorithm  to  locate  the  fault  at  the 
switching  element  level  and  counts  the  number  of  tests  needed 
in  the  algorithm.  The  second  step  counts  the  number  of  tests 
needed  for  determining  the  fault  type  in  the  subcase.  We 
proceed  to  the  first  step  after  the  Subcase  A  is  identified 
by  using  the  faulty  output  at  the  phase  1  test  and  the  phase  2 
test.  If  there  is  only  one  common  switching  element  in  the 
switching  element  sets  of  the  faulty  paths,  the  common  switch¬ 
ing  element  is  faulty.  If  there  are  two  questionable  switching 
elements,  a  procedure  should  be  performed  to  locate  the  fault. 
The  procedure,  named  Algorithm  A,  is  shown  as  follows: 

Step  1:  Subdivide  the  network  into  two  subnetworks,  L  and  R, 


with  one  of  the  two  questionable  switching  elements 
found  in  the  faulty  paths  in  L  and  the  other  in  R. 

Step  2:  Set  up  the  switching  elements  in  L  in  the  valid 
state  of  an  arbitrarily  chosen  test  phase. 

Step  3:  Compute  the  link  subsets  of  the  paths  leading  to  the 
input  lines  of  the  questionable  switching  element  in 
R  subnetwork.  One  of  the  two  paths  is  a  normal 
subpath . 

Step  4:  Use  the  same  test  vectors  as  those  in  detection  phases 
except  that  of  the  normal  path  found  in  Step  3.  Use 
the  complement  of  the  faulty  output  in  the  chosen 
test  phase  found  in  Step  2  as  the  test  vector  of  the 
normal  path. 

Step  5:  Test  R  in  two  valid  states.  If  the  two  output  vectors 
from  the  questionable  switching  element  in  R  are  equal 
to  the  normal  ones,  then  R  is  fault-free.  Otherwise 
L  is  fault-free. 

The  number  of  additional  tests  for  locating  such  a  single 
fault  is  equal  to  four. 

The  second  step  is  then  to  identify  the  fault  type.  As 
shown  in  Table  4.8,  the  four  fault  types  of  Subcase  A  can  be 
differentiated  by  using  the  information  of  the  link  via  which 
the  faulty  switching  element  sends  the  fault  output.  Hence 
the  fault  type  can  be  determined,  according  to  Table  4.8, 
by  inspecting  which  link  of  the  faulty  switching  element  passes 
the  faulty  output  to  the  terminal  in  each  test  phase.  No 
additional  test  is  needed. 

The  total  number  of  tests  required  is  equal  to  4  or  8 
which  includes  4  for  the  detection  phase  and  4  for  locating 
the  fault.  Q.E.D. 

Example :  The  example  for  Subcase  A  in  Table  4.7  is 
illustrated  here.  The  network  structure  along  with  the  test 
set-up  is  shown  in  Figs.  4.8(a)  and  (b) .  As  shown  in  Table  4.7 
there  are  two  questionable  switching  elements:  switching 
element  2  of  stage  1  and  switching  elements  3  of  stage  2. 
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The  network  is  subdivided  into  L  and  R  with  switching  element 
2  of  stage  1  in  L  and  switching  element  3  of  stage  3  in  R. 

In  Step  2  of  Algorithm  A,  phase  1  is  chosen.  The  link  subsets 
of  the  subpaths  which  lead  to  the  input  lines  of  the  question¬ 
able  switching  element  in  R  are  {10,10,5}  and  {14,14,7}.  The 
link  set  of  the  normal  subpath  is  {14,14,7}.  Since  the  faulty 
output  in  the  chosen  test  phase,  phase  1,  is  10,  the  vector 
01  is  chosen  as  the  test  vector  of  the  normal  path  in  which 
the  links  of  {14,14,7}  stay.  In  Step  5,  we  found  that  the 
test  outputs  are  equal  to  the  normal  ones.  Hence  R  is  fault- 
free  and  switching  element  2  of  stage  1  is  faulty.  Inspecting 
the  faulty  outputs  at  the  phase  1  test  and  the  phase  2  test 
we  can  see  that  the  lower  link  of  the  faulty  switching  element 
sends  the  faulty  output  in  both  test  phases.  Hence,  referring 
to  Table  4.8,  we  conclude  that  the  fault  type  if  The 

total  number  of  tests  is  equal  to  8. 

Theorem  4.5:  The  fault  location  and  the  fault  type  of 
the  Subcase  B  fault  or  the  Subcase  C  fault  can  be  determined 
by  at  most  10  tests,  independent  of  network  size. 

Proof :  If  there  is  only  a  common  switching  element  in 

the  switching  element  set  of  the  faulty  paths  at  the  phase  1 
test  and  the  phase  2  test,  respectively,  the  common  switching 
element  is  faulty.  We  then  proceed  to  test  whether  the  fault 
is  type  or  —  type.  If  there  are  two  questionable  switching 
elements,  Algorithm  A  can  also  be  used  to  locate  the  Subcase  B 
fault  or  the  Subcase  C  fault.  Step  2  of  Algorithm  A  should 
be  modified  as  "Set  up  the  switching  elements  in  L  in  the 
valid  state  of  the  test  phase  at  which  the  faulty  output  is 
a  binary  vector  (01  or  10)."  The  number  of  additional  tests 
for  locating  a  single  fault  of  Subcase  B  or  Subcase  C  is  equal 
to  four.  The  second  step  is  then  to  identify  the  fault  type. 
The  fault  types  of  Subcases  B  and  C  are  shown  in  Table  4.9 
along  with  related  output  patterns.  Since  the  output  of  <p<fi  or 
—  can  be  either  00  or  11,  the  fault  types  shown  in  Table  4.9 
can  be  partitioned  into  eight  sets  of  fault  types:  {(S^fS^), 
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k. 


Table  A.  9  Faulty  Output  Pattern  in  Subcases  B  and  C  of  Case  2. 


Faults  of 

Subcase  B 
or  C 

Upper  (U)  or  Lower  (L) 

Link  by  Which  the  Faulty 
Switching  Element  Sends 
the  Fault 

Faulty  Output: 
Binary  Vector 
00 

(01  or  10) 

(00  or  11) 

(00  or  11) 

Phase  1  Test 

Phase  2  Test 

Phase  1  Test 

Phase  2  Test 

(si2-sn> 

L 

U 

Binary  vector 

00 

(S12’S7) 

L 

L 

Binary  Vector 

00 

(S3’S13> 

U 

U 

Binary  Vector 

00 

B 

(S3’S7> 

U 

L 

Binary  Vector 

00 

(S11’S12> 

U 

U 

00 

Binary  Vector 

(sn-s3) 

U 

L 

00 

Binary  Vector 

(S14,S12) 

L 

U 

00 

Binary  vector 

(SWS3J 

L 

L 

00 

Binary  Vector 

(S12’V 

L 

U 

Binary  Vector 

— 

(S12-S1> 

L 

L 

Binary  Vector 

— 

<S3’V 

U 

U 

Binary  Vector 

— 

U 

L 

Binary  Vector 

— 

C 

(S2'S12) 

u 

U 

— 

Binary  Vector 

(s2,s3) 

u 

L 

— 

Binary  Vector 

(S8,S12) 

L 

U 

— 

Binary  Vector 

(s8,s3) 

L 

L 

— 

Binary  Vector 

(S12,S4)},{(S12,S7) ,(s12,s1)},{(s3,s13) ,(S3,S4)},{(S3,S7) , 
(s3,s1)},{(s11,s12),(s2,s12)},{(s11,s3),(s2,s3)},{(s14,s12), 

(Sg,Sl2)},  and  {(S14,S3> ,(Sg,S  )}.  The  two  fault  types  in 
each  set,  one  with  <$>$  output,  and  the  other  with  —  output, 
are  equivalent  according  to  the  output  pattern  and  additional 
tests  are  needed  to  further  differentiate  them.  The  procedure 
as  described  in  Theorem  4.3  needs  two  additional  tests.  Hence 
the  total  number  of  tests  needed  is  equal  to  6  or  10.  Q.E.D. 

Example :  The  example  for  Subcase  B  in  Table  4.7  is 
illustrated  here.  The  two  questionable  switching  elements 
are  switching  element  2  of  stage  1  and  switching  element  1 
of  stage  2.  Figs.  4.9(a)  and  (b)  show  the  network  set-up 
required  to  locate  the  fault.  In  Step  2  of  Algorithm  A,  the 
phase  1  test  is  chosen.  The  outputs  of  the  test  are  normal. 
Hence  switching  element  2  of  stage  1  in  L  is  faulty.  The 
faulty  type  is  either  (S3,S33)  or  (S3>S4)  according  to  Table 
4.9,  since  the  faulty  output  is  sent  via  the  upper  link  in  both 
test  phases.  The  test  to  determine  whether  the  fault  type  is 
(S3,Sj3)  or  (S3,S4>  is  shown  in  Fig.  4.10.  Since  the  test 
output  is  a  binary  vector  the  faulty  output  at  the  phase  2 
test  is  <p<p.  Hence  the  fault  type  is  (^.S^).  The  total 
number  of  tests  is  equal  to  10. 

Theorem  4.6:  The  fault  location  and  the  fault  type  of 
the  subcase  D  fault  or  the  subcase  E  fault  can  be  determined 
by  at  most  12  tests,  independent  of  network  size. 

Proof :  If  there  is  only  a  common  switching  element  in 

the  switching  element  sets  of  the  faulty  path  at  the  phase  1 
test  and  the  phase  2  test,  respectively,  the  common  switching 
element  (it  is  in  the  leftmost  or  the  rightmost  stage)  is 
faulty.  We  then  proceed  to  test  whether  the  fault  is  (Jm}1  type 
or  —  type  in  each  test  phase.  This  procedure  takes  four 
tests.  Hence  the  total  number  of  tests  needed  is  equal  to  8 
which  includes  four  tests  for  the  detection  phase.  If  there 
are  two  common  switching  elements  in  the  switching  element 
set  of  the  faulty  path  as  shown  in  Table  4.7,  we  have  to  take 


120 


a  procedure  to  locate  the  fault.  The  procedure,  named 
Algorithm  D,  is  shown  as  follows: 

Step  1:  Subdivide  the  network  into  L  and  R  subnetworks  with 
one  of  the  two  questionable  switching  elements  in  L 
and  the  other  in  R. 

Step  2:  Choose  a  reference  subnetwork,  R  or  L. 

Step  3:  Compute  the  link  subsets  of  the  subpaths  in  L  in 

the  two  test  phases,  which  lead  to  the  input  lines 
of  the  two  questionable  switching  elements.  There 
are  three  link  subsets  which  can  be  computed  in 
each  test  phase. 

Step  4:  Assume  that  LIU  and  LID  are  the  inputs  of  the  sub¬ 
paths  which  lead  to  the  upper  input  line  and  the 
lower  input  line  of  the  questionable  switching  element 
in  L,  respectively.  And  assume  that  RI  is  the  input 
of  the  third  subpath  which  leads  to  the  input  line  of 
the  questionable  switching  element  in  R.  If  R  is 
chosen  as  the  reference  subnetwork,  assign  LIU=LID=01 
(or  10)  and  RI=10  (or  01).  If  L  is  chosen  as  the 
reference  subnetwork,  assign  LIU=LID=RI=01  (or  10). 
Step  5:  Test  the  subnetwork  other  than  the  chosen  reference 
subnetwork  in  the  two  valid  states  and  observe  the 
two  output  vectors  from  the  questionable  switching 
element  in  R  in  each  test  phase. 

Depending  on  what  we  have  observed  in  Step  5,  we  may 
have  different  decisions.  The  decision  tree  is  shown  in 
Fig.  4.11.  Starting  at  node  1,  we  choose  R  as  the  reference 
subnetwork  and  process  one  cycle  of  Algorithm  D.  In  Step  5, 
if  there  is  no  00  or  11  in  the  test  response  of  each  test 
phase,  the  questionable  switching  element  in  L  is  faulty 
(Subcase  E) .  Then  according  to  the  faulty  output  pattern 
shown  in  Table  4.10  for  Subcase  E  we  can  determine  the  fault 
type.  If  there  is  no  00  or  11  in  one  test  phase  only,  the 
questionable  switching  element  in  L  is  faulty  (Subcase  D) . 

If  only  00  or  11  appears  at  the  phase  1  test  of  L,  then  the 
fault  type  is  among  (S2*S13),  (S^S^),  (sg*s13) >  and  (Sg,S7), 
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Fault  sec  -  {DL, DR, EL, ER.FL.FR, LINK-STUCK} 


Mnemonics  not  used  In  text: 


DL: 

fault 

of  subcase 

D 

in 

L 

V 

valid 

state 

of 

R 

DR: 

fault 

of  subcase 

D 

In 

R 

SL: 

valid 

state 

of 

L 

EL : 

fault 

of  subcase 

E 

in 

L 

Sri: 

valid 

state 

of 

R 

in 

phase 

1 

test 

ER: 

fault 

of  .subcase 

E 

in 

R 

sr2: 

valid 

state 

of 

R 

in 

phase 

2 

test 

FL: 

fault 

of  subcase 

F 

In  L 

Sli: 

valid 

state 

of 

L 

in 

phase 

1 

test 

FR: 

fault 

of  subcase 

F 

in 

R 

V 

valid 

state 

of 

L 

in 

phase 

2 

test 

LINK- 

-STUCK 

Link  stuck 

fault 

Fig.  4.11  Summary  of  test  procedures  for  Subcases  D,  E  and  F. 


Faults  of 
Subcases  D 
or  E 

Upper  (U)  or  Lower  (L) 

Link  by  Which  the  Faulty 
Switching  Element  Sends 
the  Fault 

Faulty 
44  (00 
—  (00 

Output 
or  11) 
or  11) 

Phase  1  Test 

Phase  2  Test 

Phase  1  Test 

Phase  2  Test 

(VS13> 

U 

U 

— 

44 

(S2,S7) 

U 

L 

— 

44 

(S8,S13) 

L 

U 

— 

44 

(S8’V 

L 

L 

— 

44 

D 

<sn-V 

U 

U 

44 

(sn,si> 

U 

L 

44 

— 

<S1«-V 

L 

U 

— 

<S14-S1> 

L 

L 

44 

— 

(S11,S13) 

U 

U 

44 

44 

<S11'S7> 

U 

L 

44 

44 

E 

(S1A,S13) 

L 

U 

44 

44 

<S14*S7> 

L 

L 

44 

44 

- 

and  it  can  be  determined  by  the  faulty  output  patterns  of  the 
detection  phase.  If  only  00  or  11  appears  at  the  phase  2 
test,  then  the  fault  type  is  among  (S^,S^), 

(S^,S^),  and  (S^,S^),  and  it  can  also  be  determined  by  the 
faulty  output  pattern  of  the  detection  phase.  However,  if 
there  is  00  or  11  in  the  response  of  each  test  phase,  we  have 
to  proceed  to  node  2.  At  node  2  we  choose  L  as  the  reference 
subnetwork  and  go  over  Algorithm  D  once  more.  In  this  second 
run,  we  can  make  decisions  according  to  the  test  response 
as  we  did  at  node  1,  the  decision  could  be  one  of  the  follow¬ 
ing:  the  fault  of  Subcase  E  is  located  in  R  if  there  is  no 
00  or  11  in  the  response  of  each  test  phase;  the  fault  of 
Subcase  D  is  located  in  R  if  there  is  no  00  or  11  in  the 
response  of  only  one  test  phase.  The  fault  type  can  be 
determined  in  the  same  way  as  we  did  at  node  1. 

Hence  the  total  number  of  tests  needed  to  determine  the 
fault  location  and  the  fault  type  is  equal  to  8  or  12. 

Q.E.D. 

Example :  The  example  for  Subcase  D  in  Table  4.7  is 
illustrated  here.  The  structure  of  the  example  network  and 
the  associated  test  set-up  are  shown  in  Figs.  4.12(a),  (b)  , 

(c) ,  and  (d).  The  two  test  phases  at  node  1  are  shown  in 
Figs.  4.12(a)  and  (b)  ,  respectively.  Since  there  is  00  or  11 
in  the  response  of  each  test  phase  we  proceed  to  node  2. 

The  two  test  phases  at  node  2  are  shown  in  Figs.  4.12(c)  and 
(c),  respectively.  Since  there  is  00  or  11  at  the  phase  2 
test  and  no  00  or  11  at  the  phase  1  test,  we  conclude  that 
the  fault  is  located  at  switching  element  3  of  stage  2  and 
the  fault  type  is  according  to  Table  4.10.  The 

number  of  tests  needed  is  equal  to  12. 

Remark :  The  fault  of  Subcase  F  cannot  be  pinpointed  at 
the  single  switching  element  level  and  it  is  indistinguishable 
from  a  link  stuck  fault. 

The  faulty  output  pattern  of  Subcase  F  is  shown  in 
Table  4.11.  If  the  fault  can  be  located  at  the  single  switch¬ 
ing  element  level,  then  no  additional  tests  are  needed  for 
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determining  the  fault  type  according  to  Table  4.11.  How¬ 
ever  we  can  only  locate  the  fault  at  eight  location  blocks 
shown  in  Fig.  4.13  using  the  faulty  outputs  of  the  detection 
phases.  Figs.  4.13(a)-(d)  show  the  location  blocks  of  two 
common  switching  elements  in  the  two  faulty  paths,  and 
Figs.  4.13(e)-(h)  show  the  location  blocks  of  a  common 
switching  element  in  the  two  faulty  paths,  which  should 
be  in  the  rightmost  stage  (Figs.  4.13(e)-(f))  or  the  left¬ 
most  stage  (Figs.  4.13(g)-(h))  of  the  network.  The  dash 
lines  in  Fig.  4.13  imply  the  possible  faulty  spots  which 
include  the  link  and  the  switching  element.  Because  of  the 
characteristics  of  —  fault  it  is  impossible  to  further  pin¬ 
point  the  fault  within  each  questionable  location  block  by 
applying  tests  on  the  input  side  and  observing  output  on 
the  output  side.  Hence  there  exists  an  ambiguity  between 
the  link  stuck  fault  and  the  Subcase  F  fault. 

Case  3  and  Case  4:  We  can  compute  the  switching  element 
sets  of  the  faulty  paths  and  the  intersections  of  these  sets 
should  lead  to  a  unique  faulty  switching  element.  In  these 
two  cases,  no  additional  tests  are  required  and  only  four 
tests  which  are  developed  for  the  detection  phases  are 
required  for  locating  the  fault. 

Theorem  4.7:  The  fault  location  and  the  fault  type  of 
Case  3  or  Case  4  can  be  determined  by  at  most  eight  tests, 
independent  of  network  size. 


Proof :  In  Case  3,  the  faulty  switching  element  has  two 

faulty  outputs  at  one  of  the  test  phases.  There  are  18 
fault  types  in  Case  2,  which  are  the  inner  products  of 

{S0,S1,S4,S5,S6,S7,S9,S13’S15}  X  and  {S10 }  X  {S0 ’ S2 ,S6 * 
Sg.Sg.S^.S^.S^  ’S^}.  Since  the  faulty  switching  elements 

can  be  uniquely  identified  by  the  switching  element  set  of 

the  two  faulty  paths  in  the.  same  detection  phase,  the  number 

of  tests  needed  is  equal  to  four.  Two  additional  tests  may 

be  needed  to  differentiate  4><{>  and  —  as  described  in  Theorem 

4.3.  In  Case  4,  there  are  189  fault  types  and  the  fault  type 
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Fig. 


4.13  Blocks  of  faulty  location  pattern  of  Subcase  F 

(The  dash  line  indicates  the  possible  faulty  spot). 
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can  be  any  one  in  the  union  of  the  inner  product  sets  of 

^S0,S1,S4,S5,S6,S7,S13,S15  *  X  ^  anc^  {S-S^q  )  x  ^0’^2’ 

S6,S8,S9’S10,S11,S14,S15 ^  Where  ^S-S5 ^  is  the  set  of  the 
states  shown  in  Table  4.1  excluding  S,.  and  {S-S^q  }  the  set 

excluding  S^q.  Again  the  faulty  switching  element  can  be 

uniquely  identified  by  the  faulty  switching  element  sets  of 

the  faulty  paths  in  the  detection  phases.  Furthermore,  four, 

two  or  zero  additional  tests  may  be  needed  to  differentiate 

<f>4>  and  —  as  described  in  Theorem  4.3.  Hence  the  number*  of 

tests  needed  is  equal  to  at  most  eight.  Q.E.D. 

The  single  fault  diagnosis  scheme  is  good  under  the  assump¬ 
tion  that  the  diagnosis  procedure  can  be  repeated  in  a  reasonably 
short  period  during  which  at  most  a  single  fault  could  possibly 
occur.  However,  it  is  well  known  that  many  physical  faults  of  a 
single  logical  circuit  component  cannot  be  represented  as  a  single 
fault . 

4. 3  Detection  of  Multiple  Faults 

Now  we  consider  the  detection  problem  for  multiple  faults.  By  a 
multiple  fault,  we  mean  the  simultaneous  occurence  of  any  possible 
combination  of  single  faults. 

In  the  single-fault  detection  problem,  we  derive  tests  for  every 
stuck-type  fault  at  the  link  and  functional  state  fault  in  the  switching 
element.  For  the  multiple  fault  case,  the  test  set  derived  for  detecting 
single  faults  may  fail  to  indicate  the  existence  of  the  fault  because 
some  faults  may  be  masked  by  some  other  faults.  We  would  show  an  example 
on  the  subnetwork  shown  in  Fig.  4.1.  Assume  all  the  four  switching 
elements  in  the  subnetwork  are  in  (S^,S^)  functional  state.  Then  the 
test  vectors  labelled  on  the  input  terminals  will  result  in  a  correct 
response  in  the  phase  1  test,  although  all  the  four  switching  elements 
are  faulty.  The  faulty  state  which  can  mask  a  fault  such  that  the  fault 
becomes  unobservable  is  called  the  masking  faulty  state.  In  valid 
state  S^q,  the  masking  faulty  states  are  S^,  and  S^,  and  in  valid 

State  Sj,  the  masking  faulty  states  are  S^q,  and  S^.  The  masking 

problem  of  the  example  shown  in  Fig.  4.1  can  be  solved  by  using  four 
distinctive  test  vectors.  Extending  the  solution  to  the  whole  network. 
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we  should  use  N  distinctive  test  vectors  for  N  terminals.  The  all-zero 
and  all-one  vectors  should  be  excluded  because  these  two  vectors  fail 
to  test  stuck-type  faults  at  links.  Hence,  1  +  log^N  binary  bits  are 
needed  to  form  the  test  vectors  for  the  multiple  fault.  Two  test 
phases,  similar  to  the  two  for  detecting  single  faults,  are  also  needed 
for  detecting  multiple  faults.  Concluding  the  above  discussion  we  have 
the  following  theorem. 

Theorem  4.8:  The  number  of  tests  for  detecting  multiple  faults 
is  equal  to  2(1  +  log^N) . 

4 . 6  Summary 

In  this  chapter,  we  have  presented  a  fault  model  for  the  network 
in  the  class  of  multistage  interconnection  networks.  Fault  diagnosis 
procedures  for  the  network  constructed  of  switching  elements  with  two 
valid  states  have  been  considered.  A  diagnosis  method  for  single  faults 
and  a  detection  method  for  mutiple  faults  are  developed.  In  the  diag¬ 
nosis  procedures  the  control  lines  of  the  switching  elements  in  the  same 
stage  can  be  grouped  together  and  activated  by  the  same  control  signal. 
The  control  line  grouping  of  each  stage  is  exactly  the  control  scheme 
used  in  the  flip  network  of  STARAN  [19].  Hence,  the  diagnosis  proce¬ 
dures  developed  in  this  paper  are  good  both  for  the  indirect  binary 
n-cube  network  and  the  flip  network.  Extension  to  the  network  con¬ 
structed  of  switching  elements  with  four  valid  states  is  feasible  since 
the  test  sets  of  faults  in  switching  elements  with  four  valid  states 
are  the  same  as  those  we  developed  for  switching  elements  with  two  valid 
states.  The  problem  left  is  to  design  diagnosis  procedures  with  minimal 
or  nearly  minimal  number  of  tests. 

The  number  of  tests  which  is  required  under  various  conditions 
in  the  diagnosis  procedures  developed  in  this  paper  is  summarized  as 
follows.  The  number  of  tests  for  detecting  single  faults  is  equal  to 
four  and  is  independent  of  the  network  size.  The  number  of  tests  for 
detecting  multiple  faults  is  equal  to  2(l+log2N),  where  N  is  the 
number  of  terminal  links  in  one  side  of  the  network.  The  number  of 
tests  needed  for  determining  the  fault  location  and  the  fault  type  of 
a  single  fault  depends  on  the  fault  type  and/or  the  size  of  the  net¬ 
work.  The  characteristics  of  single  switching  element  faults  are 
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Table  4.12  Characteristics  of  Single  Faults 
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summarized  in  Table  4.12.  The  minimum  number  of  tests  needed  for 


determining  the  fault  location  and  the  fault  type  is  equal  to  four 
and  the  maximum  max(12,  6  +  2 |"log( logN)]  ).  For  a  network  of  size 
N=  1024  the  maximum  is  equal  to  14.  There  exist  four  switching 
element  faults  (Subcase  F)  which  cannot  be  pinpointed  at  the  single 
switching  element  level  and  those  four  are  not  distinguishable  from 
the  link  stuck  fault.  This  study  provides  specific  information  of 
fault  characteristics  for  designing  an  easily  dlagnosable  network. 


CHAPTER  5 


THE  REVERSE-EXCHANGE  INTERCONNECTION  NETWORK 

In  many  parallel  processing  architectures,  an  interconnection 
network  is  used  to  realize  various  permutations  of  data  between  the 
processors  or  between  the  processors  and  the  memory  modules.  Due  to 
the  importance  of  the  parallel  processing,  the  design  of  cost  effective 
interconnection  networks  is  a  crucial  problem.  In  this  concern  some 
interconnection  networks  were  proposed  as  described  in  Chapter  2. 

Among  these  networks  the  flip  network  was  implemented  in  STARAN  [19] 
and  the  shuffle-exchange  network  has  been  extensively  investigated. 

The  perfect  shuffle  permutation,  on  which  the  shuffle-exchange  network 
is  based,  was  studied  by  Golomb  [70]  and  used  by  Pease  [41]  in  the 
realization  of  the  fast  Fourier  transformation.  The  shuffle-exchange 
network  was  presented  by  Stone  [71]  as  an  interconnection  network 
between  tne  cells  of  a  dynamic  memory.  A  generalization  of  Stone's 
network  was  been  proposed  by  Lavrie  [36]  and  extended  by  Lang  [72]  for 
the  processor-memory  interconnection  in  an  array  computer. 

As  far  as  these  interconnection  networks  are  concerned,  the 
remaining  problems  include  how  to  realize  all  permutations  and  how 
to  develop  efficient  routing  algorithms.  The  solutions  may  be 
approached  in  different  ways.  Our  study  on  the  addressing  schemes 
results  in  a  new  interconnection  network  named  the  reverse-exchange 
network.  In  this  chapter  we  will  introduce  this  new  network  and 
investigate  its  usefulness  to  the  remaining  problems.  Section  5.1 
describes  the  reverse-exchange  network.  Some  basic  classes  of  permu¬ 
tations  which  are  realizable  by  the  reverse-exchange  network  are 
shown  in  Section  5.2.  Routing  algorithms  which  determine  the  control 
pattern  by  the  permutation  name  are  developed  in  Section  5.3  for  those 
realizable  permutations.  In  Section  5.4  we  prove  that  the  reverse  - 
exchange  network  can  realize  all  permutations  in  two  passes.  Both 
the  construction  and  the  routing  scheme  are  provided.  Some  applications 
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on  the  parallel  processing  are  shown  in  Section  5.5. 


5 . 1  The  Reverse-Exchange  Network 

The  network  in  the  class  of  multistage  interconnection  networks, 
labelled  by  using  the  binary  tree  coding  scheme,  is  actually  a  reverse  - 
exchange  network.  In  this  section,  we  illustrate  the  reverse-exchange 
network  using  the  baseline  network. 

The  reverse-exchange  network,  shown  in  Fig.  5.1,  which  connects 
N=2n  terminals  on  Side  1  to  2°  terminals  on  Side  2,  is  composed  of  n 
stages  of  2  x  2  switching  elements  linked  by  a  bit-reverse  intercon¬ 
nection.  Each  2x2  switching  element  can  either  send  their  inputs 
straight  through  (state  0)  or  exchange  them  (state  1).  The  bit-reverse 
interconnection  is  an  interconnection  when  all  switching  elements  in 
the  network  are  in  state  0,  the  positional  relationship  between  Side  1 
and  Side  2  is  in  bit-reverse  order.  The  interconnection  is  divided 
into  n+1  levels.  The  leftmost  and  rightmost  levels  are  identity 
interconnections.  The  interconnections  between  two  adjacent  stages 
are  described  by  Eqs.  (3.1)  and  (3.2). 

The  permutation  function  of  the  reverse-exchange  network  is 
accomplished  by  two  components  -  the  interconnection  links  and  the 
switching  elements.  The  interconnection  links  perform  the  bit-reverse 
permutation  and  the  switching  elements  perform  the  exchange  permuta¬ 
tion.  Assume  the  binary  representation  of  integer  X  is  x^x^,  .  ..x^, 

where  £=n-l.  The  interconnection  link  of  level  i,  performs  the 
following  permutation: 


VV£-r 


•  x0)  = 


V  ••x£-i+2x0X£-i+l”‘Xl’ 


(5.1) 


for  0  <  i  <  £.  For  i=0  and  £+1 , 


Ri(x£x£-r--xo)  =  x£x£-r--V  (5<2) 

By  Eqs.  (5.1)  and  (5.2)  we  have 

R£+1(VR£-1-(R0(x£x£-1-x0))--))  =  W"X£,  (5‘3) 

Eq.  (5.3)  implies  that  the  overall  interconnection  links  of  the  network 
perform  the  bit-reverse  permutation.  The  exchange  is  performed  by  a 
switching  element  on  two  inputs  named  by  adjacent  numbers.  The  exchange 
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permutation  is  defined  as 


*  x£x£-r • ,xo 


if  c=0  , 
if  c=l  , 


(5.4) 


where  c  is  the  control  bit  of  the  switching  element  and  c=0  for  state 
and  c=l  for  state  S^.  Since  there  are  N/2  switching  elements  in 
a  stage,  there  is  a  control  vector  associated  with  each  stage.  The 
notation  of  C^(j)  and  are  used  to  denote,  respectively,  the  control 
bit  for  jth  switching  element  in, stage  i  and  the  exchange  permutation 
of  stage  i  associated  with  control  vector  . 

The  permutation  of  the  reverse-exchange  network  realized  is 
determined  by  the  value  of  the  control  vector  C^'s,  0  f  if  £.  Assume 
X  is  permuted  to  P(X)  by  the  network.  Then 

P^X£X£-1‘ -  -X0^  =  R£+1('E£<'R£(E£-1‘  *  *  (Rl(E0(R0(x£X£-l' "  *x0^^  * 

=  (e0(x0)*e1(x1)...e£_1(xJl_1)-e£(x£))  ,  (5.5) 

where  e^(x^),  0  f  i  f  £,  is  equal  to  x^  or  x^  depending  on  the  exchange 

performed  by  the  associated  switching  element  in  stage  i.  Fig.  5.2 

shows  an  example  of  a  permutation  realized  on  the  network  of  size 
3 

N=2  with  control  vectors  as  specified. 

To  have  the  reverse-exchange  network  perform  the  permutation,  it 
is  necessary  to  be  able  to  derive  the  control  vectors  according  to 
the  permutation  specifications.  The  homogeneous  routing  technique 
of  the  binary  tree  coding  method  shown  in  Chapter  3  are  developed  for 
the  reverse-exchange  network.  Using  this  routing  technique  we  can 
calculate  the  control  vectors  based  on  the  source-destination  pair 
of  binary  names.  However,  similar  to  the  flip  network  and  the  shuffle  - 
exchange  network,  not  every  permutation  can  be  realized  by  the  reverse  - 
exchange  network.  The  reverse-exchange  network  is  capable  of  realizing 
2°  x  ^  permutations,  which  is  considerably  less  than  2°!,  the  total 
number  of  possible  permutations  on  {0 , 1 ,2  , . . .  , 2n-l) .  It  is  noted  that 
the  number  of  permutations  which  are  useful  in  parallel  computation  is 
also  much  less  than  2°!.  The  usefulness  of  the  reverse-exchange  network 
in  parallel  computations  depends  on  how  many  permutations  useful  in 
parallel  computations  can  be  realized  by  the  network  in  one  pass  or 
multiple  passes. 
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5.2  Permutations  Realizable  by  the  Reverse-Exchange  Network 

The  permutations  realizable  by  the  reverse-exchange  network  are 
a  subset  of  2°!  distinct  permutations.  In  this  section  we  will  demon¬ 
strate  some  permutations  in  this  subset,  which  are  useful  for  the 
parallel  processing. 

Recall  from  Chapter  3  that  given  the  source-destination  pair  of 

permutation  request  P(A.)=Z.,  represented  by  (A  ,Z  )  =  (a  „a  „  .... 

1  3  jj  ],)!  j,H 

n  *  1za  o  stage  m  will  switch  source  a.  .a.  ...a. 

3,  £  j ,  x-1  j  ,0  ,  j,2  j ,  1  j  ,0 

to  link  z  „z.  0  ...z.  a,  .a.  .  ....a.  z.  in  level  m+1. 

j,£  j,£-l  j , £-m+l  j  ,£  3,£-l  j  ,m+l  j,£-m 

A  conflict  occurs  if  some  other  source  is  also  switched  to  this  link. 

That  is,  for  some  pairs  of  permutation  requests,  say  (A.,Z.)  and 

(Ak,Zk),  and  for  some  m,  we  have  a.  ,  f  j  ,  £_r  ■  •  3j  >m+1  «  ak  ,£ak,  • 

\,m+l  and  Zj  , £Zj  , £-1 "  ‘  ’ Zj  , £-m  =  zk,£zk,£-r  ' ‘Zk,£-m-  If  we  define 

^p,q  3p  ,  £3p ,  £-1 .  .  .  3p  ,  £-q+l  and  Zp,q  z  p  ,  £zp  ,  £-1 '  '  '  zp  ,  £-q+l  *  t*le 

conflict  condition  can  be  represented  as  A,  .  =A,  .  and  Z.  , ,  = 

j  ,  £-m  k,£-m  j  ,  rrH-1 

Zk  m+1  ^°r  Perrnutation  requests  p(Aj  =  and  p(A^)  =  zk-  Thus  the 

following  theorem  defines  the  class  of  permutations  which  can  be 
realized  by  the  reverse-exchange  network. 


Theorem  5.1:  Given  a  set  of  distinct  permutation  requests, 

P„  =  { (A. ,Z . ) I  0  <  i  <  N},  P„  can  be  realized  by  the  reverse-exchange 
Nil  N 

network  if  and  only  if  A.  4  A,  and  A.  .  =  A,  .  implies  Z  , ,  ^ 

3  k  3,£-m  k,£-m  j ,m+l 

Z  for  j  ^  k,  0  f  j,k  <N  and  0  5  m  <  £. 

k ,m+l  J  J 

Using  Theorem  5.1  we  will  identify  some  of  the  permutations  which 
can  be  realized  by  the  reverse-exchange  network. 

r 

Theorem  5.2:  Define  to  be  the  number  whose  binary  represen¬ 
tation  is  the  reverse  binary  representation  of  and  define  P  = 
{(Xi,X^)  |  0  <  i  <  N)}  to  be  the  bit-reverse  permutation.  Then  P^  is 
realizable  by  the  reverse-exchange  network. 

Proof :  Assume  X^  jj  3  =  \  £  3  for  0  -  i  -  where  j  4  k.  Since 
Xj  4  X^  for  j  +  k  we  then  obtain  X^  ^  X^  from  the  assumption. 

The  proof  immediately  follows  Theorem  5.1.  Q.E.D. 
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Theorem  5.3:  The  permutation  defined  by  =  {(X^,aX^)  |0  <  i  <  N 
and  a  is  an  odd  integer}  is  realizable  by  the  reverse-exchange  network. 

Proof:  Define  Y.  =  aX^.  We  will  prove  that  X.  .  =  X.  .  for 

-  i  i  ^  2  *  £-ni  * » 

j  +  k  and  0  <  m  <  £  implies  Y.  ,  t  Y  . 

2  »m+l  k  ,m+l 

Since  X.  .  =  X.  for  j  i  k  and  0  f  m  <  i  implies  X^  .  j 

j  ,  £-m  k,£-m  J  K  J  ,m+l 

*k  ,nrt-l  *  hence’  Xj  ,  £Xj  ,  £-1  ’  *  ‘  Xj  ,m+l  =  \ ,  t\ ,  £-1'  *  ‘ \  ,m+l  3nd 

x.  x.  , ...x.  .  J  x.  x,  ,  ...x,  Assume  further  that  x,  .  /  x, 

j  ,m  j,m-l  j  ,0  W.,m  k,m-l  k,0  j  ,t  K,t 

for  some  t ,  0  S  t  5  m  and  Xj  s  =  ^  s  f°r  c  <  s  5  m.  Let  b^b^_^...bQ 

be  the  binary  representation  of  a  where  b^  =  1  since  a  is  odd.  The 
r  r 

products  of  Y.  =  aX^  and  Y^  =  aX^  are  shown  as  follows: 


X.  „  .  .  X . 

J,0  J.t 

Xj,t+1  *  '  Xj,* 

*  b£ 

■  •  •  bi  bo 

x.  .  .X. 

J,0  J,t 

Xj,t+1  ’  Xj,£-2  Xj,£-1  Xj,£ 

b ,  x .  .  .  b,x.  j  b ,  x .  .  .  b.x,  .  .  b ,  x .  „ 

lj.l  lj,t  j  lj,t+l  1  J.H  U-* 

b.x  .  b.x.  b  x . 

2  j  ,2  2  j ,t ;  2  j,t+l 

•  •  Vj.t 

+  .  . 

• 

yj,o  •  *  yj,t-l  yj,t 

yj.t+l  •  yj,e 

and 

•i-i 

o 

\,t+l  •  ‘  ‘  Xk ,  il 

X  b£  •  • 

.  .  .  bl  bQ 

\,o  •  _ • _ l. 

^.t+l  -  ^,£-2  ^,£-1  \,SL 

bl\,l  •  •  Vk.tj  bl\,t+l  •  •  bl\,£-l  bl\,£ 

b2\,2  •  Vk.tj ‘V'k.t+l 

‘  b2\,£ 

+ 

• 

yk,0  ’  '  yk,t-l  yk,t 

yk,t+l  '  yk , £-2  yk , £-1  yk,t 

The  right  sides  of  the  dark  lines  in  both  cases  are  equivalent  since 


X,  .  =  X,  „  .  The  above  result  shows  that  *=  ^  and  Y  4 

j, x-t  k  ,  £-t  3 ,m  k,m  j  ,t 

X.  if  X  4  X,  and  X.  *  X  for  t  <  m  5  £.  This  result  con- 

k, t  j,t  Tc.t  3  ,m  k,m 

eludes  that  X.  „  =  X,  „  for  j  4  k  and  0  f  m  <  l  implies  Y.  4 

3,£-m  k,£-m  J  K  j ,m+l 


Y 


k  ,m+l ' 


Q.E.D. 


Theorem  5.4:  If  =  {(A^,Z^)  |  0  ^  i  <  N)  is  realizable  by  the 
reverse-exchange  network  and  b  is  an  integer,  then  P'  =  {(A^.Z^+b)! 

0  <  i  <  N}  is  also  realizable  by  the  network. 

Proof:  Let  Y.  =  Z.+b.  It  is  obvious  that  Z.  .,42.  .  .  for 

-  l  l  3 ,m+l  k,m+l 

0  f  m  <  £  implies  that  Y.  4  Y,  ...  Hence  A.  .  =  A,  „  for 

3  ,m+l  k,m+l  3,£-m  Tc,£-m 

j  4  k  and  0  f  m  <  £  implies  Z.  4  2.  and  also  Y.  .  4  Y,  ... 

j  ,m+l  k,m+l  3,nH-l  k,m+l 

Q.E.D. 

Corollary  5.1:  The  permutation  defined  by  P^  =  {(X^.aX^+b)  j 
0  -  i  <  N,  a  is  an  odd  integer  and  b  is  an  integer},  is  realizable  by 
the  reverse-exchange  network. 

Corollary  5.2:  The  permutation  defined  by  P^,  =  {(X^,T-X^)  j 
0  f  i  <  N  and  T  is  an  integer}  is  realizable  by  the  reverse-exchange 
network. 

Corollaries  5.1  and  5.2  are  consequences  of  Theorems  5.3  and  5.4. 
Theorem  5.5:  If  P.,  =  {(A.,Z.)  |  0  £  i  <  N}  is  realizable  bv  the 

Nil1 

reverse-exchange  network  and  k  is  an  integer,  then  P'  =  {(A^.Z^  Q  k)  j 
0  f  i  <  N  and  ©  is  the  bit-by-bit  EXCLUSIVE  OR}  is  also  realizable 
by  the  network. 


Proof:  Define  Y 


i  ’  zx  ©  k- 


It  can  be  seen  that  Y.  4  Y 

3  ,m  k,m 


exchange  network,  A. 


J  »  » 

if  Z.  4  ?.  for  0  <  m  £  £.  Since  P„  is  realizable  by  the  reverse- 
j  ,m  k  ,m  N 

„  =  A,  .  for  j  4  k  and  0  5  m  <  £  implies 

3 , £-m  k , £-m  r 

2.  4  2,  , . .  Hence  A.  „  =  A,  .  for  i  4  k  and  0  -  m  <  £  also 

3  ,m+l  k,nrt-l  3,£-m  k,£-m  J 

implies  Y.  4  X,  ...  Q.E.D. 

3  ,m+l  k,m+l 


Theorem  5.6:  The  permutation  defined  by  =  {(aX^+b,X^)  | 

0  5  i  <  N,  a  is  an  odd  integer  and  b  is  an  integer}  is  realizable  by 
the  reverse-exchange  network. 


Proof:  Define  Y.  =  aX,  +b.  If  X,  „  =  X,  „  ,  it  is  obvious 

-  i  i  j,£-m  Tt,£-m 
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_ _ 


t 

.  _  _  _  _ * _ U _  i  ' 


that  Y 


j , £-m' 


Y,  0  for  some  m'  *  m.  Since  X,  0  *  X,  0  for 

k ,  £-m  _  j  ,  £-m  k ,  £-m 

=  Y,  „  for 


j  4  k  and  0  -  m  <  £  implies  XZ  4  )C  Y.  0  -  -  *,  0 

J  v  j  ,m+l  k  ,m+l  j,£-m  k ;  £-m 

j  4  k  and  0  -  m'  <  £  also  implies  xf  4  x5  . 

j ,m  +1  k ,m  +1 


Q.E.D. 


Theorem  5.7:  Define  the  following  binary  representations: 


and 


Xi  =  (xi,lxi,4-l-”xifjxi>j-l-"xif0) 

U  =  (x.  .  .  .  .x.  n) 

i,J~l  i,0 

Y.  =  (y.  n...y,  .  ,x.  ,...x.  „  ,x.  ) 

i  i,0  ■'i.j-l  i,j  i,£-l  i,£ 

v  -  (yi,j_1---yi>0)- 


Assume  V  *  U  +  k  mod  2J ,  where  k  is  an  integer.  Then  the  permutation 
defined  by  =  {(X^,Y  )  |  0  -  i  <  N}  is  realizable  by  the  reverse- 
exchange  network. 

Proof :  By  the  definition,  if  (x 


x  , . . . x  )  4  (x  x  ... 

p,mp,m-l  p,0  q,mq,m-l 


x  ),  then  (y  y  ,...y  n)  4  (y  y  ....y„  „)  for  either 
q ,  0  p ,  m  p , m- 1  p ,  0  q  ,  m  q  ,  m- 1  q ,  0 

in  i  j  or  m  >  i .  Hence  X  .  =  X  „  for  p  4  q  and  0  5  m  <  £  implies 

J  J  p,£-m  q,£-m  r  M 


Y  4  Y 

p,m+l  q,m+l 


Q.E.D. 


Theorem  5.8:  If  P,,  =  {(A.,Z.)  |  0  5  i  <  N}  is  realizable  by  the 
- Nil1 

reverse-exchange  network,  then  P'  =  {(Z^,A^)  |  0  5  i  <  N}  is  also 
realizable  by  the  network. 


Proof :  Since  P^  is  realizable  by  the  reverse-exchange  network, 

a.  „...a.  ,,  =  a.  „...a,  for  1  4  k  and  0  5  m  <  £  implies 

j  ,£  j  ,m+l  k,£  k,m+l 

z.  „...z.  „  4  z,  „...z,  n  •  By  contradiction,  assume  that  in  the 

j,£  j , £-m  k , £  k. £-m 

case  of  z.  ....z,  , ,  =  z,  „ . . . z,  . ,  for  j  4  k  and  0  5  q  <  £  we  can 

j,£  J,q+1  k, £  k,q+l 

have  a.  „...a,  „  =a,  „ .  . . a,  .  .  Then  there  exists  m  =  £-q-l  such 

j , £  j.£-q  k,£  k.  £-q 

j,£  j  ,nr+l  k ,  £  k,nrt-l  j,£  j,£-m 


Zk,£" * ’zk,£-m' 


This  contradicts  the  statement  shown  in  the  beginning  of  this  proof. 
Hence  *j  >q+1  =  zk , *•  *  •  zk ,q+l  for  J  *  k  and  0  f  q  <  £  implies 

aj,r--aj,£-q  *  \,£-"ak,£-q-  Q-E,D- 

In  this  section  we  have  presented  some  theorems  which  prove  that 
some  classes  of  permutations  are  realizable  by  the  reverse-exchange 
network  in  one  pass. 
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5 . 3  Controlling  the  Reverse-Exchange  Network 

The  homogeneous  routing  procedure  described  in  Chapter  3  already 
provides  a  simple  routing  mechanism.  It  employs  the  n-bit  source  tag 
and  the  n-bit  destination  tag  to  determine  the  valid  state  of  the 
in-path  switching  elements.  The  mechanism  also  facilitates  a  conflict 
resolution  scheme.  This  routing  mechanism  suggests  a  general  routing 
procedure  for  all  permutations.  However  there  are  at  least  two  related 
reasons  for  us  to  pursue  alternative  routing  algorithms.  First,  it 
would  be  quite  expensive  to  implement  the  general  routing  procedure 
for  a  large  network.  Second,  the  permutations  which  are  useful  for 
the  parallel  processing  and  realizable  by  the  reverse-exchange  network 
can  be  classified  into  a  limited  number  of  classes.  It  is  preferable 
to  determine  the  control  pattern  by  the  name  of  the  class  of  permuta¬ 
tions  rather  than  to  consider  the  general  routing  procedure.  In  this 
section  we  will  classify  the  permutations  which  are  described  in 
Section  5.2,  look  into  the  characteristics  of  each  class,  and  present 
a  routing  scheme  which  determines  the  control  pattern  by  the  permuta¬ 
tion  name. 

The  permutations  which  are  proven  to  be  realizable  by  the  reverse- 
exchange  network  in  one  pass  are  classified  into  the  following 
categories . 

1)  F(kn)  (0  f  k  <  2n)  :  X  -*•  Xr  @  k 

F(kn)(0  <  k  <  2n)  :  X1’  ©  k  -  X 

2)  C(n),  (0  <  j,  k  <  2n,  j  odd):  X  -  jXr  +  k 

3 

c(.n)  (0  f  j,  k  <  2n,  j  odd):  jXr  +  k  ->•  X 

3  >  k 

3)  R^nj*  (0  t  j,  k  <  2n,  j  odd):  jX  +  k  -*•  Xr 

3  >k 

R^  (0  5  j  ,  k  <  2n,  j  odd)  :  Xr  -  jX  +  k 

4)  S^n?(0  iqin,  0  1  k  <  2q)  :  cyclic  shift  of  amplitude  k 

q,k 

within  each  segment  of  size  2 
as  described  in  Theorem  5.7. 
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The  control  bit  of  a  switching  element  is  denoted  either  by 
0  or  by  1  depending  on  whether  the  desired  function  is  the  direct 
connection  or  the  crossed  connection.  A  N/2  or  2n  '-bit  vector  is 
needed  to  control  each  stage.  The  generated  bit  pattern  for  the 
network  can  be  structured  as  a  cascaded  matrix  of  column  vectors,  a 
binary  tree,  or  a  reverse  binary  tree.  For  a  cascaded  matrix  of 
column  vectors,  n  vectors  of  length  2°  '  are  concatenated  forward  or 
backward  and  form  the  2n  '  x  n  control  matrix.  In  case  of  the  reverse 
binary  tree  the  generated  vector  of  stage  i  (0  5  i  5  n-1)  is  split 
into  2n  *  '  vectors  of  length  2*.  These  2^-bit  vectors  of  stage  i 
are  shuffled  into  a  2n  '-bit  vector,  column  i  of  the  control  matrix. 
In  the  case  of  the  binary  tree,  the  generated  vector  of  stage  i  is 
split  into  2 '  vectors  of  length  2n  '  '.  These  2n  *  '''-bit  vectors 
of  stage  i  are  concatenated  into  2°  ''-bit  control  columns  of  the 
control  matrix. 

Denote  by  M^n^(P)  =  (m..),  0  -  i  f  2n  '  -  1  and  0  5  j  5  n-1, 

the  control  pattern  of  2n-J-x  n  matrix  associated  with  a  permutation 

P  and  by  K^n\p)  the  generated  bit  pattern  of  n  columns  according 

to  recursive  formulas  to  be  demonstrated.  Denote  also  by  v^n  ^ (b) 

the  2n  "*-bit  vector  whose  components  are  all  equal  to  b.  A  binary 

tree  whose  root  is  a  vector  v  and  whose  upper  subtree  and  lower 

subtree  are  K  and  K  ,  respectively,  is  denoted  by  [v;  K  ,K  ]. 

u  v  u  v 

Similarly,  the  reverse  binary  tree  is  denoted  by  [  ;v].  The 

cascaded  matrix  whose  left  part  and  right  part  are  L  and  R,  respec¬ 
tively,  is  denoted  by  [L;R]. 

Let  k  be  a  positive  integer  and  denote,  respectively,  by  k'  and 
k  ,  its  quotient  and  its  remainder  in  the  division  by  2,  i.e., 
k  =  2k'  +  kj. 

Algorithm  1(a):  If  n  1  2  ,then 

K(n)(F£)  =  [K(n"l)(F",);  v(n_1)(k1)]. 

If  n  =  1,  then 

=  [v(n_1)(k’)]. 
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Example :  Assume 


P  = 


/O  1  2  3  4  5  6  7  \ 
^3  7  1  5  2  6  0  4  / 


P  can  be  described  by 

.(3).  ..  . 


:r  ©  3 


According  to  Algorithm  1(a) ,  we  have 

K(3)(F(33))  =  [v(2)  (0)  ;v(2)  (1)  ;v(2)  (1)  ]  . 


M(3) (P) 


Hence , 

ro  1  n 
0  1  1 
0  1  1 
L  0  1  1  J 

The  setting  of  the  network  is  illustrated  in  Fig.  5.3. 
Algorithm  1(b)  :  If  n  2  2,  then 

R(n)(~(n))  =  [v(n-l)(k^).K(n-l)(p(n))1> 

If  n  =  1,  then 

K(1)(F(kn,})  =  [  v(n_1)(k')]. 


Example :  As  s  ume 


P  = 


/0  1  2  3  4  5  6  ?\ 
yi  5  3  7  0  4  2  6 | 


P  can  be  described  by 

F(43)  :  xr  ©  4  -  x. 

According  to  Algorithm  1(b),  we  have 
,(3),~(3) 


K' 


Hence 


M(3)(P) 


<fv  ) 


r  o  o  i 
0  0  1 
0  0  1 
0  0  1 


[v(2)(0);v(2)(0);v(2)(l)]. 
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The  setting  of  the  network  is  illustrated  in  Fig.  5.4. 


Algorithm  2(a)  :  Let  j  =  2j '  +  1.  If  n  ^  2,  then 

z'  [..(n-D /pCn-D  .  w(n-l).  (n-1)  . 

1  J  ,  (j  ,+l)k1+k ' '  ,K  ^j.d-k^j'+k'^ 


K(n)(C(n)) 
J  .k 


v(n  ^  (k1) ]  ,  if  k1  =  0; 

f),(n-l) /r(n-D  (n-1)  (n-1)  >. 

1  ^  j.d-kpj'+k')^  C  j,(j'+l)k1+k’;’ 

v(n  1’)  (k^)  ] ,  if  k^  *=  1. 


If  n  =  1,  then 


K(1)(C(1>)  =  [k], 
J  » k 


Example:  Assume 


0  1  2  3  4  5  6  7  8  9  10  11  12  13  14  15 

7  15  11  3  1  9  5  13  12  4  0  8  6  14  10  2 


P  can  be  described  by 

:  x  -*■  5xr  +  7. 


The  first  application  of  Algorithm  2(a)  results  in 

.(3)  r  n 


j  =v(3>d). 

C(3)  i 

5,6  ! 

“  (3)  (3) 

Similarly,  we  can  apply  Algorithm  2(a)  to  Cc  0  and  Cc  ,  ,  and  obtain, 

o  ,  J  j  ,  o 

respectively,  the  reverse  binary  trees: 


Mi 


1 


xr? 


Thus  we  have 


K(4>(C<‘>)  = 


[0]  1  1 

m  |>J  i 

[0]  fo  1 

[0]  0  1 


(4)  (4) 

Shuffling  the  subvectors  in  each  column  of  K  (C.  _),we  can  obtain 

r° 1 1 1 

I  1  0  0  1  I 


M(4)(P)  = 


0  111 
0  10  1 
1111 
0  0  0  1 
0  111 
110  1 


The  setting  of  the  network  is  illustrated  in  Fig.  5.5. 
Algorithm  2(b):  Let  j  =  2  j  '  +  1.  If  n  *  2,  then 


K(n)(C^>). 


r  (n  1)  /u  \  .  ..(tl-l)  ) 

lv  (k1),  K  C  j ,(j ’+1)^+^' * 

„(n-l)  ,„(n-l)  \i  if  k  =  0‘ 

K  (  j,(l-k1)j'+k';j’  11  1  U’ 

rv(n_1)fk  )  •  ) 

lv  (k^,  K  tCj  .(l-k^j’+k’'  ’ 

11  if  k  =1 
J  »(j '+l)k1+k'^  ’  11  *1 


If  n  *  1,  then 


K(1)(Cj(^)  =  [k]. 


Example:  Assume 


- 


If  n  =  1,  then 


K' 


(Rj,k)  ‘  [k]- 


Algorithms  3(a)  and  2(b)  result  in  the  same  control  pattern.  The 
example  for  Algorithm  2(b)  is  also  good  for  Algorithm  3(a). 

Algorithm  3(b)  :  Let  j  =  2 j '  +  1.  If  n  *  2,  then 

z’ fv(n-D  ^(n-D  \  (n-l).'(n-l)  v. 

lK  (Rj,(j'+l)k1+k’:>’  K  ^j.d-k^j'+k"1’ 


K(n)(R<n>)= 
J  »*C 


v(n  1)(k1)],  if  kx  -  0  ; 

,„(n-l)  ~(n-l)  .  (n-1)  ~(n-l)  , 

1  (  j,(l-k1)j'+k,)’  K  j . ( j '+l)k1+k ' ’ ’ 

v(n_1)(k1)],  if  k1  =  1. 


If  n  =  1,  then 

K(1)(R(1?)  =  Ik] . 

J 

Algorithms  3(b)  and  2(a)  result  in  the  same  control  pattern.  The 
example  for  Algorithm  2(a)  is  also  good  for  Algorithm  3(b). 


Algorithm  A:  Let  0  -  q  -  n.  If  n  -  2,  then 


K(n) 


(S 


(n) 

q,k 


) 


.  (n-1).  (n-1).  (n-1),  (n-1)  , 

lK  q  ,k '  K  '  q  ,k  *+k  ^  ’ 


v(n'1)(k1)],  if  k:  =  0; 
v(n_1)(k1)],  if  kj  -  1, 


where  K^n  "^(S^,^)  =  K^n  q^(cjn  q^).  If  q  *  n  (equivalent  to 
q  ,k  1,0 

Algorithm  2(a)  for  j  =  1) ,  then 

K(1)(S(1))  _  [k]> 
n  ,K 

Example :  Assume 

_  /  0  1  2  3  A  3  6  7  8  9  10  11  12  13  14  15 

I  3  11  7  15  1  9  5  13  0  8  A  12  2  10  0  14 

'  (4) 

P  can  be  described  by  -  which  is  a  cyclic  shift  of  amplitude  3 

2 

within  each  segment  of  size  2  as  shown  in  Fig.  5.7. 

The  first  application  of  Algorithm  A  results  in 


15A 


Similarly,  we  can  apply  Algorithm  4  to  and  and  obtain, 

^  » X  2 ,  2 

respectively , 


Hence  we  obtain 


The  setting  of  the  network  is  illustrated  in  Fig.  5.8. 

5 . 4  Realization  of  A rbitrary  Permutation s 

In  this  section  we  will  first  show  that  all  permutations  can  be 
realized  by  the  reverse-exchange  network  in  two  passes.  Next,  we 
consider  the  routing  scheme  for  this  two-pass  construction. 

A.  Two-pass  permutations 

The  fact  that  the  Benes  binary  network  can  realize  all 
permutations  between  its  inputs  and  outputs  follows  the  result 
of  Slepian-Dupid  theorem.  Using  the  above  fact,  we  will  prove 
that  the  reverse-exchange  network  can  realize  all  permutations 
in  two  passes. 

Theorem  5.9:  The  reverse-exchange  network  can  realize  all 
permutations  in  two  passes. 

Proof :  The  theorem  will  be  proven  by  showing  that  the 
functions  of  the  Benes  binary  network  can  be  simulated  by  the 
baseline  network  in  two  passes.  An  example  construction  for  a 
two-pass  implementation  using  a  baseline  network  is  shown  in 
Fig.  5.9.  The  input  data  are  fed  in  on  Side  1.  The  output  data 
of  the  first  pass  are  stored  in  the  shift  register  files  on 
Side  2.  In  the  second  pass,  the  data  in  the  register  files  are 
fed  back  to  the  input  lines  on  Side  1  and  the  final  results  are 
again  stored  in  the  register  files. 

The  two-pass  construction  is  equivalent  to  the  implementation 
of  cascading  two  baseline  networks.  An  example.  Fig.  5.10,  shows 
the  equivalent  construction  of  the  two-pass  construction  shown  in 
Fig.  5.9.  The  two  baseline  networks  shown  in  Fig.  5.10  are 
labelled  with  logical  names. 

According  to  the  previous  result  we  can  obtain  a  reverse 
baseline  network  via  properly  permuting  the  switching  elements 
and  its  related  links  of  the  baseline  network.  For  switching 
elements  in  the  reverse  baseline  network,  the  mapping,  Yi ,  from 
physical  names,  (p^p  1 . . .  i  to  logical  names  (b^b^ .  .  .b^) 
is  shown  in  Chapter  3.  The  mapping,  from  logical  names  to 
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/ 


stage 


0 


2 


3 


Fig.  5.8 


Setting  for  S 


(4) 
2,3  • 
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5.9  Two-pass  construction  for  a  reverse-exchnnRe  network. 


for  0  5  i  -  £.  If  we  rearrange  the  switching  elements  and  its 
related  links  of  the  baseline  network  for  the  second  pass  in  the 
equivalent  construction  in  ascending  order  of  the  physical  names, 
which  are  obtained  by  applying  y  of  Eq.  (5.6)  on  the  logical 
names,  we  can  obtain  a  construction  which  is  formed  by  connecting 
a  baseline  network  to  a  reverse  baseline  network  end  by  end.  An 
example  is  shown  in  Fig.  5.11.  The  labellings  shown  in  Fig.  5.11 
are  the  logical  names.  Now,  by  setting  the  switching  elements  in 
the  first  stage  of  the  reverse  baseline  network  in  the  equivalent 
construction  on  the  state  of  the  direct  connection,  we  then  show 
that  the  equivalent  construction  functions  exactly  as  a  Benes 
binary  network.  The  setting  is  shown  in  Fig.  5.12  for  the  exam¬ 
ple.  It  can  be  seen  that  the  construction  shown  in  Fig.  5.12  is 
equivalent  to  that  shown  in  Fig.  5.13.  Q.E.D. 


B.  Routing  scheme 

Several  authors  have  proposed  algorithms  which  compute 
control  patterns  for  the  Benes  binary  network  for  any  one-to-one 
permutation  assignment.  Among  these  are  the  scheme  by  Opferman 
and  Tsao-Wu  [29]  and  the  looping  procedure  by  Anderson  [73]. 
Although  these  two  algorithms  are  good  for  any  permutation 
assignment  on  the  Benes  binary  network,  they  both  need  memory 
storage  for  implementing  the  algorithm  and  the  computing  time 
needed  is  in  the  order  of  (N/2) log2 (N/2) .  However,  Lenfant  [74] 
claimed  that  these  algorithms  are  both  time-consuming  and  space¬ 
consuming.  In  order  to  meet  the  time  constraints  arising  from 
the  use  of  a  Benes  binary  network  as  the  alignment  network, 
Lenfant  proposed  a  routing  algorithm 'for  frequently  used  permu¬ 
tations  which  are  classified  into  five  families.  For  each  family 
the  routing  algorithm  can  control  the  two-state  switches  on  the 
fly  as  the  vector  of  data  passes  through  the  network. 

These  three  algorithms  can  also  be  used  in  our  two-pass 
construction  which  can  realize  all  permutations  as  the  Benes 
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binary  network  does.  However,  the  computed  control  pattern  should 
properly  be  permuted  before  it  can  be  applied  to  the  reverse- 
exchange  network.  As  shown  in  Theorem  5.9,  the  leftmost  n 
stages  of  the  Benes  binary  network  are  one-to-one  correspondent 
to  the  reverse-exchange  network  of  the  first  pass  from  left  to 
right,  and  the  rightmost  n-1  stages  of  the  Benes  binary  network 
are  one-to-one  correspondent  to  the  reverse-exchange  network  of 
the  second  pass  from  right  to  left.  The  switching  elements  in 
the  left  most  stage  of  the  reverse-network  of  the  second  pass 
are  refined  to  be  in  the  valid  state  of  the  direct  connection. 
Assume  that  signals  0  and  1  represent  the  valid  states  for  the 
direct  and  the  crossed  connection.  We  can  represent  the  control 
pattern  of  the  Benes  network  and  the  reverse-exchange  network  by 
the  following  matrices: 

1.  Benes  binary  network 


’o,o 

bo,i  ••• 

bO,2n-2 

*1,0 

bl,l  ••• 

bl,2n-l 

!’° 

b„ 

h  , 

N 

I’° 

» 2n-2 

2.  Reverse-exchange  network  of  the  first  pass 


0,0 

bo,i  •• 

"  b0,n-l 

'1,0 

bl,l  • 

bl  ,n-l 

bN  bv 
—  f)  —  1 

2  ,U  2  ’ 1 


N 

2»n_1 


3.  Reverse-exchange  network  of  the  second  pass 

0  an  1  • • *  an  1 

0,1  0,n-l 

0  a  ...  a 

1,1  1 ,n-l 


0  "Si 
2  ’ 1 


^,n-l 


Hen 


ce ,  given  matrix  B,  we  can  immediately  obtain  matrix  R^  and 
derive  matrix  by  performing  the  following  permutation  according 
to  Eq.  (3.6): 


aj  ,i  bk ,n+i-l  ’ 


(5.7) 


where  j  =  r^~^(k)  and  1  <  i  £  n-1. 


Example :  Assume  the  following  control  pattern  is  computed 
by  using  one  of  the  algorithms  [29,72,73]  for  the  8x8  Benes 
binary  network: 


-  0  0  0  0  o- 
0  10  10 
10  10  1 
.11111. 


The  setting  of  the  Benes  binary  network  is  illustrated  in 
Fig.  5.14.  We  can  immediately  obtain 

■  0  0  0  - 

R  =  010 

1  10  1 

-111-. 


Since,  according  to  Eq.  (5.7),  we  have 

f 

a0,l  =  b0,4 
81,1  =  b2,4 
a2,l'bl,4 
a3,l  =  b3,4  ’ 

k 
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and 


a0,2  =  b0,5 
al,2  =  bl,5 
a2,2  =  b2,5 
a3,2  =  b3,5 


we  can  obtain 


0  0  0 
0  0  0 
0  1  1 
0  1  1 


The  setting  of  the  two-pass  construction  is  shown  in  Fig.  5.15. 


5 . 5  Applications  on  Parallel  Processing 

The  reverse-exchange  network  can  be  considered  as  an  intercon¬ 
nection  network  which  can  permute  data  on  transfers  from  memory  to 
processor  modules,  from  processor  to  memory  modules,  and  from  proces¬ 
sor  to  processor  modules  in  a  parallel  processing  system.  In  this 
section  we  will  consider  several  of  the  aspects  in  one  pass. 

A.  Bit-reverse  permutation 

The  bit-reversal  permutation  is  vitally  important  to  the 

computation  of  the  fast  Fourier  transformation.  The  flip  network 

and  the  shuffle  exchange  network  cannot  realize  the  bit-reverse 

permutation  in  one  pass.  The  permutation  class  of  R^n?  and 

J  »R  J  »k 

which  are  realizable  by  the  reverse-exchange  network  in  one  pass 
clearly  indicates  that  the  scrambled  data  can  be  aligned  in  tit- 
reverse  order  and  the  bit-reverse  data  can  be  restored  in  the 
original  scrambled  order. 


B.  Multi-dimensional  access  (MPA)  memory  data 

In  a  multi-dimensional  access  memory  [44],  data  can  be 
accessed  (fetched  or  stored)  by  words,  by  bit-slices,  by  byte- 
slices,  etc.  MDA  data  is  scrambled  in  a  certain  way  such  as 
p-ordered  scramble  [75]  and  uniform  shift  when  stored  in  memory 
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so  that  it  can  be  accessed  in  various  ways.  A  scramble/unscramble 

network  is  required  to  scramble  the  data  when  it  is  stored  into 

memory  and  to  unscramble  the  data  when  it  is  read  from  memory. 

The  shuffle-exchange  network  does  the  scrambling  (x  -»  jx+k)  and 

the  unscrambling  (jx+k  ■*  x) .  The  flip  network  also  does  the 

scrambling  (x  -*■  x  Q  k)  and  unscrambling  (x  ©  k  -»  x) .  However , 

if  we  modify  the  scrambling  and  the  unscrambling  a  little  bit  as 

described  by  F^  ,  F^J^  ,  c[n^  ,  and  ,  we  can  achieve  the  same 

*  K  J iK  j  ,k 

purpose  of  the  multi-dimensional  access  via  the  reverse-exchange 
network  although  the  data  location  is  modified. 

C.  Partitioning  of  an  array  computer  into  blocks  of  2^  processors 
An  array  computer  can  be  composed  of  large  numbers  of  pro¬ 
cessors  for  the  fast  realization  of  large  problems.  However,  in 
some  circumstances,  the  computation  should  be  divided  into  sub¬ 
groups  and  each  group,  either  identical  or  heterogeneous,  can 
be  performed  in  a  small  subarray  of  processors  and  achieve  the 
efficiency  through  parallelism.  Hence,  it  is  convenient  in  these 
cases  to  be  able  to  partition  the  computer  into  various  subarrays. 
The  permutation  class  of  shows  that  the  partition  can  be 

supported  by  the  reverse-exchange  network.  A  partition  has  been 
shown  in  Fig.  5.7  in  which  the  16  processors  are  partitioned  into 

2^  (q=2)  groups.  As  shown  by  the  definition  of  ,  the  cyclic 

shift  of  any  amplitude  is  allowed  in  each  of  the  subarrays. 

Another  important  factor  which  makes  the  reverse-exchange  network 
more  favored  to  the  parallel  processing  application  is  that  all 
permutations  can  be  realized  by  the  reverse-exchange  network  in  just 
two  passes  and  the  control  pattern  of  each  pass  can  easily  be  obtained 
by  using  the  existing  efficient  routing  algorithms. 

5 . 6  Summary 

We  have  presented  a  reverse-exchange  network.  The  permutations 
which  are  realizable  by  the  reverse-exchange  network  are  classified 
into  four  groups  and  routing  algorithms  which  compute  the  control 
patterns  according  to  the  permutation  group  names  are  developed. 
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It  is  also  proven  that  all  permutations  can  be  realized  by  the  reverse- 
exchange  network  in  two  passes.  Both  the  construction  and  the  routing 
algorithm  are  provided.  The  network  is  shown  to  be  useful  for  the 
bit-reversal  permutation,  the  multi-dimensional  access  memory  and 
partitioning  the  array  computer.  Overall,  the  reverse-exchange  network 
is  a  powerful  interconnection  network  for  the  parallel  processing 
system. 


CHAPTER  6 

LOGIC  PARTITIONING  OF  MULTISTAGE  INTERCONNECTION 
NETWORKS  FOR  LSI  IMPLEMENTATION 


Recent  proposals  on  computer  architecture  consider  computer 
systems  with  as  many  as.  2^  to  2^  processors.  The  implementation 
of  the  interconnection  networks  in  such  large  systems  is  a  critical 
problem  for  the  designers.  The  need  of  having  a  cost-effective  LSI 
implementation  of  the  interconnection  network  is  obvious.  However, 
there  is  very  limited  research  activity  on  the  issue  of  LSI  implemen¬ 
tation.  In  this  Chapter  we  will  tackle  some  problems  on  the  LSI 
implementation  of  the  baseline  network.  The  results  are  also  good 
for  other  equivalent  networks. 

For  a  cost-effective  LSI  implementation,  the  minimization  of 
the  number  of  modular  types  is  of  prime  importance.  Hence  it  would 
be  a  good  criterion  to  partition  the  network  into  functionally  and 
physically  equivalent  modules  so  that  the  hardware  and  the  software 
can  modularly  be  developed.  However,  there  also  exist  some  limitations 
on  LSI  technology.  The  maximum  number  of  gates  and  pins  allowed  in 
an  LSI  chip  are  frequently  used  to  describe  the  limitations.  Also, 
the  gate-to-pin  ratio  in  the  actual  implementation  has  been  used  to 
measure  the  cost  effectiveness.  The  problem  of  the  LSI  implementation 
here  is  then,  given  the  maximum  allowable  number  of  gates  and  pins 
in  an  LSI  chip,  to  implement  the  network  with  the  minimum  number  of 
modular  types  and  the  maximum  gate-to-pin  ratio. 

This  study  generates  a  generalized  partition  formula  for  the 
LSI  implementation,  a  measurement  on  the  cost-effectiveness  and  a 
scheme  for  interconnecting  circuit  chips.  Section  6.1  first  illus¬ 
trates  some  examples  for  the  logic  partitioning  and  then  shows  a 
general  partition  formula.  In  Section  6.2  we  manipulate  the  general 
partition  formula  for  minimizing  the  number  of  modular  types  and  in 
Section  6.3  we  count  pin  numbers  in  the  implementation  and  provide 
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a  measurement  on  the  cost  effectiveness.  The  scheme  of  interconnecting 
circuit  chips  in  an  implementation  is  developed  in  Section  6.4. 

6. 1  Partitioning 

Assume  the  network  of  size  N=2n  cannot  be  implemented  in  a 
single  circuit  chip  because  of  the  pin  or  gate  limitation.  Parti¬ 
tioning  the  network  into  composite  subnetworks  then  becomes  a 
necessary  design  step.  We  will  illustrate  the  partitioning  on  the 
example  network  shown  in  Fig.  3.3  and  extend  the  partitioning  to  the 
general  case.  Fig.  6.1  shows  a  partition.  As  shown  in  Fig.  6.1(a), 
the  network  can  be  implemented  by  a  subnetwork  shown  in  Fig.  6.1(b), 
which  has  four  switching  elements  and  16  pins.  Another  partition  is 
shown  in  Fig.  6.2.  In  Fig.  6.2(a)  we  can  see  that  the  first  and  the 

last  two  stages  are  implemented,  respectively,  by  four  subnetworks 
2  2 

of  size  2  .  The  subnetwork  of  size  2  shown  in  Fig.  6.2(b)  has  four 

switching  elements  and  eight  pins.  The  switching  elements  of  each 

subnetwork  in  the  first  two  stages  are  marked  with  the  same  letters 

as  shown  in  Fig.  6.2(a)  and  those  of  the  subnetwork  in  the  last  two 

stages  are  shown  in  dash  lines.  The  total  pin  number  required  in 

the  partition  of  Fig.  6.2  is  much  less  than  that  required  in  the 

partition  of  Fig.  6.1.  To  reduce  the  total  pins  required,  we  prefer 

the  partition  scheme  whose  composite  subnetwork  has  switching  elements 

for  different  stages.  The  partition  shown  in  Fig.  6.2  can  be  expressed 

as  n=2+2.  Fig.  6.3  shows  another  partition  example.  As  shown  in 

Fig.  6.3(a),  the  first  stage  is  implemented  by  eight  subnetworks  of 

size  2^  and  the  last  three  stages  are  implemented  by  two  subnetworks 
3 

of  size  2  which  are  shown  in  the  blocks  of  dash  lines.  The  composite 

3  1 

subnetwork  of  size  2  and  2  are  shown  in  Fig.  6.3(b)  and  (c)  ,  respec¬ 
tively.  The  partition  is  then  n=l+3.  The  last  partition  example  is 
shown  in  Fig.  6.4.  The  first  two  stages  are  implemented  by  four 
subnetworks  of  the  type  shown  in  Fig.  6.2(b)  and  the  last  three 
stages  are  implemented  by  two  subnetworks  of  the  type  shown  in 
Fig.  6.3(b).  Again,  the  switching  elements  of  each  subnetwork  in 
the  first  two  stages  are  marked  with  the  same  letters  and  those  of 
the  subnetwork  in  the  last  three  stages  are  shown  in  dash  lines.  The 
second  stage  of  the  network  is  repeated  in  the  implementation.  The 
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Fig.  6.3  The  third  partition  example. 

(a)  The  partition. 

(b)  Subnetwork  for  the  last  three  stage 

(c)  Subnetwork  for  the  first  stage  . 


nrrnnn 


three  stages 

i^i 


two  stages 


(a) 


Fig.  6.4  The  fourth  partition  example. 

(a)  The  partition. 

(b)  Interconnection  associated  with  the 
partition . 
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stage  repetition  does  not  affect  the  network  function  if  the  2x2 
switching  elements  in  a  redundant  stage  can  be  set  without  exchange 
as  shown  in  Fig.  6.4(b).  The  partition  expression  becomes  n=2-l+3. 

Thus  an  implementation  of  a  consecutive  stages  of  the  network, 

Ot 

using  the  subnetwork  of  size  2  ,  is  called  an  q-partial  implementation. 
If  there  are  r  stages  repeated  in  an  implementation  of  the  network, 
this  implementation  is  called  the  implementation  of  r-stage  repetition. 
In  general,  the  partition  can  be  expressed  as  the  following: 

n  =  +  a2  -  62  +  ...  +  Vl  -  6R_1  + 

k  (6.1) 

=  Z  (a  -  6  )  , 

i=l  1  1 

where  represents  a  partial  implementation  of  the  network  and  6^ 
is  equal  to  1  or  0  depending  on  whether  there  exists  a  stage  repetition 
between  the  ix-partial  implementation  and  the  successive  partial 
implementation.  Eq.  (6.1)  can  be  rewritten  as 

k  k  k  p 

Z  (a.  -  6,  )  =  I  a.  -  I  6.  =  I  m.*B.  -  q  ,  (6.2) 

•  i1  k  .,t  .  ,  l  .  ,  j  l 

i=l  1=1  i=l  j=l  J  J 

where  8.  /  8.  if  i^j,  B.  e  {a.  Il-i5k},0<p<k  and  0  <  q  <  k. 

lj  j  i'  “ 

The  following  remarks  are  associated  with  Eqs .  (6.1)  and  (6.2). 

Remark  1:  The  number  of  partial  implementations  of  the  partition 
expressed  by  Eq.  (6.1)  is  equal  to  k. 

Remark  2 :  Assume  the  composite  subnetwork  along  its  control 
structure  is  implemented  in  a  circuit  chip.  The  number  of  the  modular 
types  of  the  circuit  chips  needed  in  the  implementation  expressed  by 
Eq.  (6.1)  is  equal  to  p.  The  minimization  of  the  number  of  the  modular 
types  then  becomes  the  minimization  of  p. 

Remark  3:  The  implementation  of  Eq.  (6.1)  is  an  implementation 

P 

of  q-stage  repetion  and  q  <  I  m.. 

j  =  l  J 

Remark  4:  The  subnetwork  needed  in  an  x-partial  implementation 
is  a  2°tj*-  x  2ai  baseline  network  which  can  be  implemented  in  a  circuit 
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chip  and  the  number  of  chips  needed  is  equal  to  2°  . 

Remark  5 :  There  are  a^01*  ^  2  x  2  switching  elements  in  the 
subnetwork  needed  in  an  a^-partial  implementation. 

6 . 2  Minimizing  the  Number  of  Modular  Types 

An  approach  to  implementing  a  network  of  any  size  N  (N=2n) 
with  circuit  chips  of  one  single  modular  type  is  shown  here. 

Theorem  6.1:  A  multistage  network  of  any  size  N  (N=2n)  can 
be  implemented  by  using  circuit  chips  of  at  most  two  modular  types. 

Proof :  For  any  integer  a  f  n ,  it  is  always  possible  to  express 

n  in  terms  of  a  as  shown  in  the  following  way: 

n  =  0*0.  +  R,  (6.3) 

where  0  f  8  <  a,  and  Q*a  represents  a  network  repeated  Q  times. 

It  is  a  trivial  case  for  n=l,  since  the  network  can  be  imple¬ 
mented  by  using  the  circuit  chip  containing  the  subnetwork  shown  in 
Fig.  6.3(c).  For  n  1  2,  according  to  Eq.  (6.3),  we  can  always  find 
an  a  and  an  R,  where  2  5  a  -  n  and  0  -  R  <  a  such  that  the  network 
can  be  implemented  by  Q  a-partial  implementations  and  one  R-partial 

implementation.  The  a-partial  implementations  can  be  realized  by 

Ot  Cl 

the  circuit  chip  containing  a  2  x  2  baseline  network  and  the 

R-partial  implementation  can  be  realized  by  the  circuit  chip  con- 
R  R 

taining  the  2  x  2  baseline  network.  If  R  is  equal  to  zero,  then 
only  one  modular  type  is  needed  for  the  implementation.  Q.E.D. 

Due  to  the  limitation  on  the  numbers  of  pins  and/or  gates 
allowed  in  an  LSI  chip,  the  size  of  a  circuit  chip  used  in  a  partial 
implementation  should  be  confined  in  the  allowable  range. 

Assume  the  circuit  chip  containing  a  2°'ni  x  2nnl  baseline  network 
and  the  related  control  logic  is  the  maximally  allowable  one.  The 
a^-partial  implementation  is  called  the  maximum  partial  implementation. 

The  network  whose  size  is  less  than  2CXm  can  be  implemented  in  a 
circuit  chip.  The  implementation  of  the  network  whose  size  is  larger 
than  2am,  with  circuit  chips  of  one  single  modular  type,  is  described 
in  the  following  theorem. 
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Theorem  6.2:  For  the  network  whose  size  N  (N=2°)  is  larger  than 

2°t,n,  i.e.  ,  n  >  a  ,  there  exists  a  maximum  a,  (a  )/2  <  a  -  a  ,  such 
m  mm 

that  the  network  can  be  implemented  by  a-partial  implementations  which 
can  be  realized  by  using  circuit  chips  of  one  single  modular  type. 

Proof :  The  theorem  can  be  proven  by  showing  that  there  exists 
a  partition  expression  such  as 

n  *  t*B  -  q,  (6.4) 

where  (a  )/2  <  6  f  a  and  q  <  t.  Eq.  (6.4)  implies  that  the  network 
m  m 

can  be  implemented  by  t  a-partial  implementations  with  q  stage 

repetitions.  This  implementation  can  be  realized  by  using  circuit 

chips  which  are  of  the  same  modular  type.  The  circuit  chip  contains 

8  g 

a  2  x  2  baseline  network  and  the  related  control  logic. 

By  Eq.  (6.3)  we  have 


n  =  Q  -a  +  R  , 
mm  m 


(6.5) 


where  0  f  R  <  a  and  Q  ^  1.  Eq.  (6.5)  can  be  transformed  into 
m  in  m 


n  =  (Q  +l)(a  -j)  -  la  -R-j (Q+l)] . 
mm  m  m  m 


(6.6) 


The  remaining  proof  work  is  to  show  that  there  exists  an  integer  j 
with  the  property  of  0  f  j  <  (a  )/2  such  that 


0  f  a 


m  Vj(Qm+1)  5  Om¬ 

ni  m  m  m 


(6.7) 


For  the  case  of  a  -  R  5  Q  we  can  set  i=0  and  obtain  the  following 
m  m  m  J 

equation  from  Eq.  (6.6)  : 


(Q  +l)a  -  (a  -R  ) 
mm  mm 


(6.8) 


If  we  set  t=Q  +1,  f3=a  and  q=a  -R  we  can  obtain  Eq.  (6.4)  from 
m  m  m  m 

Eq.  (6.8).  For  the  case  of  a  -R  >  Q  we  should  set  j  *  1  in  order 

m  m  m 

to  have  0  f  a  -R  — j (Q  +1)  5  Q  .  However  j  should  be  less  than  (a  )/2. 

m  m  m  m  m 

We  will  verify  the  statement  using  proof  by  contradiction.  Assume 
j  >  f  (am)  /  2*|  •  Then 


CVRm"j(V’1)  5  an,"Rm'(Om/2)(0m+1) 
m  m  m  m  m  m  m 


(6.9) 


From  Eq.  (6.9)  we  have 


(6.10) 


am'Rm_j(Qm+1)  -  tam-Rm-(CtJ/2]  "  l<0  )/2]  * 

m  m  m  m  m  m  m  m 

Since  a  -R  -(a  )/2  <  (a  )/2  and  Q  -  1 ,  we  have,  from  Eq.  (6.10) 
m  m  m  m  in 


a  -R  -j(Q  +1)  <  (a  )/2  -  (a  )/2  . 
m  m  m  m  m 


(6.11) 


Eq.  (6.11)  implies 


a  -R  -j(Q  +1)  <  0 
m  m  J  m 


(6.12) 


Eq.  (6.12)  contradicts  Eq.  (6.7).  Hence 


0  5  j  <  (am)/2. 


(6.13) 


Using  Eq.  (6.6)  and  (6.13)  and  setting  t=Q  +1,  q=a  -R  -i  (Q  +1)  and 

m  m  m  m 

B=a  -j ,  we  can  at  least  obtain  an  expression  of  Eq.  (6.4).  There 
may  be  several  values  of  j  which  can  lead  Eq.  (6.6)  to  Eq.  (6.4) 
and  the  least  of  those  values  makes  the  implementation  use  the 
largest  circuit  chips  of  one  single  mocular  type.  Q.E.D. 

14 

Example :  Assume  that  the  network  size  N  is  equal  to  2  (n=14) 

and  am=6.  According  to  Eq.  (6.3)  we  have  n=2,6+2  which  means  that 

the  network  can  be  implemented  by  two  six-partial  implementations 

and  one  four-partial  implementation.  From  Eq.  (6.6)  we  have 

n=(2+l)*6-4  if  we  set  i=0.  Since  q(=4)  >  Q  (=2),  we  have  to  set 

m 

j  >  0  in  Eq.  (6.6).  Setting  j  =  1 ,  we  can  obtain  n=(2+l)«5-l.  It  is 

an  implementation  of  one-stage  repetition.  The  implementation 

employs  three  five-partial  implementations  which  can  be  realized 

by  using  circuit  chips  of  one  single  modular  type.  The  circuit  chip 

contains  a  2^  x  2^  baseline  network  and  the  related  control  logic. 

9 

The  total  number  of  circuit  chips  needed  is  equal  to  3*2  . 


6. 3  Analysis  on  Pins 

We  will  count  the  total  pin  number  of  the  circuit  chips  required 
in  an  implementation.  A  circuit  chip  needs  pins  for  input  and  output 
terminals  of  the  network  body,  for  the  control  of  switching  elements, 
for  the  chip  selection  and  for  the  power  supply  and  ground.  In  an 

a-partial  implementation  each  circuit  chip  has  2  pins  for  input 

Ct 

terminals  and  2  pins  for  output  terminals.  Usually,  three  pins 
are  required  in  a  circuit  chip  for  the  power  supply  and  ground.  The 
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number  of  pins  for  the  chip  selection  depends  on  the  total  number  of 
circuit  chips  incorporated  for  the  overall  network.  And  the  number 
of  pins  for  the  control  of  switching  elements  in  a  circuit  chip 
depends  on  the  control  structure  required  for  the  network  functions. 
However,  how  to  implement  the  control  structure  is  still  subjected 
to  investigation. 

Some  relationships  between  the  control  structure  and  the  manip¬ 
ulating  functions  has  been  shown  in  [19],  [38]  and  [43]  for  synchro¬ 
nous  operations.  Accordingly  the  control  structure  has  been  classi- 
fiedinto  three  categories  in  [50]:  individual  stage  control, 
individual  box  control  and  partial  stage  control.  The  realization 
of  the  control  structure  depends  on  the  capability  of  the  LSI 
technology,  the  response  time  requirement  and  the  routing  techniques, 
etc.  Besides  the  synchronous  operation,  the  asynchronous  operations 
are  also  useful  for  the  multiprocessing  and  distributed  processing. 
Taking  the  control  structure  into  account,  we  design  two  modules  for 
our  analysis  on  pins,  one  for  the  asynchronous  operations  and  the 
other  for  the  synchronous  operation  with  the  individual  stage  control. 

A.  Design  of  a  Module  for  the  Asynchronous  Operation 

First,  the  control  structure  of  the  2x2  switching  element 
for  the  asynchronous  operation  is  subjected  to  investigation. 

Fig.  6.5  shows  seven  possible  valid  states  for  the  2x2  switch¬ 
ing  element.  Three  control  bits  must  be  used  to  implement  these 
seven  valid  states.  However,  these  seven  states  can  be  divided 
into  two  equivalent  sets:  {a,b,c,f}  and  {a,d,e,g}.  The  former 
set  can  be  implemented  by  state  f  without  conflicting  the  func¬ 
tional  implementation  of  each  valid  state  in  the  set  and  the 
latter  by  state  g.  An  appropriate  input  and  output  mask  scheme 
can  be  used  to  prevent  routing  errors  induced  by  unused  paths. 
Hence,  instead  of  using  three  control  bits  for  the  seven  valid 
states,  we  use  only  one  control  bit,  c,  to  implement  state  f 

(c=0)  and  state  g  (csl).  Next,  we  will  consider  the  routing 

ot 

problem  in  a  module  containing  a  network  of  size  2  .  Let  £=a-l. 
Assume  that  a  source  link  A  =  a£ajj  i'*‘a0  on  t^e  ^•e^t  si^e  of 
the  network  is  to  be  connected  to  a  destination  link 
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Z  ■  z^z^_...z  on  the  right  side  of  the  network.  From  the 
previous  result,  the  set  of  2  »  2  switching  elements  which  are 
in  the  connected  path  is 

S  =  *(z«,  •  •  ,Zi>-i+l  aJLaS.-l--,ai+l)i  I  0  -  1  -  (6,14) 


The  control  bit,  c,  of  switching  element  (z^. . 
ai+l^i  can  sent  as 


z£-i+l  a£a£-l' 


c 


‘4-i 


© 


a . . 
i 


(6.15) 


Hence,  to  implement  the  routing,  the  following  hardware  feature 
should  be  incorporated:  2(£+l)-bit  control  register  for  storing 

the  source  and  destination  address,  a^.-.a^  and  z^.-.Zq,  a 
decoder  for  implementing  Eqs.  (6.14)  and  (6.15),  a  distribution 
register  array  for  storing  the  control  bits,  c's.  An  example 

4 

is  shown  in  Fig.  6.6  for  a  module  containing  a  network  of  size  2 

and  the  control  logic.  In  Fig.  6.6  the  circle  in  each  switching 

element  block  represents  the  correspondent  control  bit  of  the 

distribution  register  array.  As  seen  in  Fig.  6.6,  there  are 
ot 

2  pins  for  the  control  registers,  in  which  a  pins  are  for  the 
source  tag  and  the  other  a  pins  are  for  the  destination  tag, 

Ot  Ct 

2  pins  for  the  input  terminals  and  2  pins  for  the  output 
terminals.  Besides,  three  pins  are  needed  for  power  and  ground, 
and  a  few  for  the  chip  selection  which  depends  on  the  number  of 
circuit  chips  incorporated  for  the  overall  network.  Hence  the 

Ot+1 

total  number  of  pins  needed  in  the  module  is  equal  to  2  +  2a  + 

3  +  s,  where  s  is  the  number  of  pins  needed  for  the  chip  selec¬ 
tion. 


B.  Design  of  a  Module  for  the  Synchronous  Operation  with 
Individual  Stage  Control 

Again  we  will  consider  the  design  of  a  module  containing 
a 

a  network  of  size  2  .  The  individual  stage  control  uses  the 
same  control  line  for  all  switching  elements  in  the  same  stage. 
Since  there  are  a  stages  of  switching  elements,  we  can  use  a  pins 
each  of  which  feeds  routing  information  into  a  control  bit  for  a 
specified  stage.  Including  the  pins  for  the  chip  selection,  for 
the  power  supply  and  ground,  and  for  the  terminals,  we  have 
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2a+^  +  a  +  3  +  s  pins  in  the  module,  where  s  is  the  number  of 
pins  needed  for  the  chip  selection. 

Consider  the  implementation  for  the  asynchronous  operation 
first.  Since  the  total  number  of  pins  of  a  circuit  chip  which 
contains  a  2°*  x  2a  baseline  network  is  equal  to  2a+^  +  2a  +  3  + 
s,  we  can  express  the  total  pin  number  of  an  a^-partial  implemen¬ 
tation  as 

p.  -  (2ai+1  +  2ai  +  3  +  s)  •  2n'ai,  (6.16) 

where  s  is  the  number  of  pins  for  the  chip  selection.  Since 
there  are  k  partial  implementations  the  total  number  of  pins 
for  the  implementation  is  equal  to 

k  k 

P  =  Z  p.  «  k  •  2n  1  +2n  •  Z  (3+s+  2a  )/2ai  .  (6.17) 

i=l  1  i=l  i 

k 

Because  there  are  I  2  1  chips  used  in  the  implementation,  the 

i=l 

number  of  pins  for  the  chip  selection,  s,  can  be  expressed  as: 

k 

s  =  log  (  Z  2n_ai)  .  (6.18) 

i-1 

Substituting  Eq.  (6.18)  into  Eq.  (6.17)  we  have 

P  =  k  •  2n+1  +  log  (  Z  2n_0ti)  •  2n  •  I  —  + 

1  i=l  i*l  2ai 

k 

2n  •  Z  (3  +  2a  )/2ai.  (6.19) 

i=l  1 

From  Eq.  (6.19)  we  can  see  that  the  number  of  pins  required  in 
an  implementation  depends  on  the  number  of  partial  implementa¬ 
tions,  k,  the  size  of  the  partial  implementation,  a^,  and  the 
network  size,  2n. 

Similarly,  we  can  obtain  the  number  of  pins  required  in  the 
implementation  for  the  synchronous  operation  with  the  individual 
stage  control. 

Since  there  are  n  2°  2  x  2  switching  elements  required 

in  the  definition  network,  the  ratio  of  P  and  n  2n  ,  called  , 
can  be  used  as  a  measurement  on  the  cost  effectiveness  instead 
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of  using  the  gate-to-pin  ratio.  Specifically, 
o  -  P/(n*2n_1) 

lc  k  k 

=  -  [2k  +  log,(  Z  2n-0ti)  •  Z  +  Z  (3  +  2a.)/2ai]  . 

n  L  i=l  i«l  2ai  i=l  1 

(6.20) 

In  the  sense  that  the  less  of  the  value  0  the  more  the  cost 
effectiveness  of  the  implementation,  we  can  obtain  an  optimal 
LSI  implementation  by  comparing  the  0  values  of  candidate  imple¬ 
mentation. 

6.4  Interconnecting  Circuit  Chips 

The  chip  interconnection  problem  can  be  defined  as  that  of 
properly  interconnecting  the  output  terminals  of  a  partial  implemen¬ 
tation  to  the  input  terminals  of  the  successive  partial  implementation 
such  that  the  implementation  results  in  a  network  whose  overall  inter¬ 
connection  pattern  between  two  adjacent  stages  (excluding  those 
between  the  stage  and  its  repeated  stages)  can  be  described  by  the 
topology  describing  rules  of  the  definition  network. 

The  chip  interconnection  problem  of  two  consecutive  partial 
implementations  can  be  considered  in  two  cases  depending  on  whether 
there  is  a  stage  repetition  between  these  two  partial  implementations 
or  not.  In  the  case  of  having  a  stage  repetition,  the  output  termi¬ 
nals  of  the  first  partial  implementation,  named  (p^p^  i'‘’po^i’  is 
connected  to  the  input  terminals  of  the  successive  partial  implemen¬ 
tation,  also  named  (p^p^  i’,,po^i‘  In  t*ie  case  having  no  stage 
repetition,  the  topology  describing  rules  shown  in  Eqs.  (3.1)  and 
(3.2)  can  be  used  to  connect  the  two  partial  implementations. 

However,  in  both  cases,  the  binary  representation  of  switching 
elements  in  the  two  partial  implementations  must  be  identified  before 
the  interconnecting  can  proceed.  Hence  the  chip  interconnection 
problem  becomes  the  problem  of  the  binary  name  assignment  on  the 
switching  elements  in  a  circuit  chip. 

The  problem  of  the  binary  name  assignment  on  the  switching 
element  in  a  circuit  chip  will  be  solved  here.  Assume  stages  i, 
i+1,  ....  i+a-1  in  the  network  of  size  N*2n  are  implemented  by  an 


187 


a-partial  implementation  consisting  of  2°  01  circuit  chips.  Each 
of  these  chips  contains  a  2  x  2  baseline  network.  These  circuit 
chips  can  be  aligned  side  by  side  and  the  switching  elements  in  the 
same  stage  line  up  in  a  column.  The  circuit  chips  are  named  by  the 
sequence  from  0  to  2°  a-l  with  0  for  the  circuit  chip  on  the  top 
and  2n  01  -  1  for  the  circuit  chip  in  the  bottom.  There  are  two  kinds 
of  names  which  can  be  associated  with  a  switching  element.  One  is 
the  physical  name  which  identified  the  location  of  a  switching 
element  in  the  circuit  chip.  Another  is  the  logical  name  which 
identifies  the  logic  position  of  a  switching  element  in  the  defini¬ 
tion  network  and  is  used  in  the  topology  describing  rules.  The 
physical  names  of  the  switching  elements  in  a  circuit  chip  can  be 
obtained  by  labelling  the  switching  elements  according  to  the  posi¬ 
tion  order  in  the  same  stage. 


Example :  For  circuit  chips  of  the  same  type  which  implement 

stage  0,  1  and  2  of  the  network  shown  in  Fig.  6.7(a)  are  aligned 
side  by  side  as  shown  in  Fig.  6.7(b).  The  switching  elements  in  the 
same  chip  are  identified  by  the  same  letter  in  Fig.  6.7(a).  The 
physical  names  of  the  switching  elements  in  each  circuit  chip  are 
also  shown  in  Fig.  6.7(b)  by  decimal  numbers. 

Our  problem  is  then  to  find  the  logical  name,  (b^b^  2‘‘"bl^i+j’ 
of  the  switching  element  whose  physical  name  is  (p^  ^p^  2"‘‘Pl^j 
Lt  chip  k,  where  0  <  j  <  a,  0  5  k  <  2°  a  and  n=ot+l.  Ass 


in  circuit 


ume 


that  a  ...a,  is  the  binary  code  word  of  k.  The  logical  name  of 
n-a  1 

that  switching  element  can  be  expressed  as: 


(b£b£-l‘  '  *bl^i+j 


(a  ...  a 
n-a 


n-a-i+1  pa-l'''pa-j  an-a-i' ‘ ‘ 3lPa-j-l‘ ' ' pl^ i+j 


(6.21) 


Example :  The  logical  name  assignment  on  the  switching  elements 
is  shown  in  Fig.  6.8  for  the  partial  implementation  of  the  network 
shown  in  Fig.  6.7.  In  the  partial  implementation,  n=5 ,  a=3,  i=0, 

0  f  j  f  2,  and  0  5  k  5  3.  Plugging  these  numbers  into  Eq .  (6.21) 
we  obtain  the  logical  names  as  shown  in  Fig.  6.8(b)  which  are  one-to- 
one  correspondent  to  those  shown  in  Fig.  6.8(a). 
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6.8(a) 


Fig.  6.8  Name  assignment  in  the  partial  implementation 

(a)  Logical  names  in  the  definition  network. 

(b)  Logical  names  in  the  subnetworks  . 


6.5  Summar' 


In  this  chapter  we  have  shown  a  logic  partitioning  scheme  which 
can  be  used  to  implement  a  class  of  multistage  interconnection  net¬ 
works  optimally  in  the  sense  of  using  LSI  circuit  chips  of  one 
modular  type  and  resulting  in  the  maximum  switching  element-to-pin 
ratio.  The  scheme  can  be  divided  into  four  major  parts.  The  first 
part  shows  how  to  partition  the  network  and  results  in  a  general 
partition  formula.  In  the  second  part  the  general  partition  formula 
is  manipulated  to  minimize  the  number  of  modular  types.  As  shown  in 
Theorem  6.2,  if  the  maximum  size  of  the  network  which  can  be  imple¬ 
mented  in  an  LSI  circuit  chip  is  equal  to  2 0,11 ,  we  can  always  imple¬ 
ment  the  baseline  network  of  size  2n ,  n  >  o  ,  using  circuit  chips 

1,1  a 

of  one  type,  each  of  which  contains  a  baseline  network  of  size  2 

where  (a  )/2  <  a  -  a  .  In  the  third  part  we  count  the  total  pins 
m  m 

needed  in  an  implementation  partitioning.  The  last  part  tackles  the 
problem  of  interconnecting  circuit  chips  to  fulfill  the  topology 
describing  rules  which  define  the  network  structure.  A  formula  has 
been  developed  to  identify  switching  elements  in  each  circuit  chip. 
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CHAPTER  7 


CONCLUSION 

The  problem  of  interconnecting  units  in  a  multiple-processor 
system  is  receiving  increasing  attention.  The  interconnection 
organizations  of  time-shared/ common  buses,  crossbar  switches  and 
multiport  memory  schemes  have  their  limitations  when  the  number  of 
functional  units  in  the  system  becomes  large  because  of  the  impact 
of  recent  advances  in  LSI  technology  and  the  projected  processing 
requirements.  In  this  respect,  the  multistage  interconnection 
networks  have  been  considered  as  good  candidates  for  the  intercon¬ 
nection  organization.  However,  previous  works  on  the  multistage 
interconnection  networks  generally  relate  only  to  the  network  topology 
or  the  implementable  permutation  functions.  A  few  investigators 
have  considered  routing  algorithms.  However,  the  important  network 
such  as  Benes  binary  network  has  been  ruled  out  because  the  routing 
algorithms  for  the  Benes  network  are  not  fast  enough  for  highly 
parallel  computer.  The  future  technology  evolution  has  not  been  taken  into 
account.  Furthermore,  most  of  the  authors  have  claimed  that  their 
network  is  the  best  without  providing  strong  evidences.  Hence, 
reviewing  previous  works,  we  feel  that  this  important  field  is  still 
lacking  a  set  of  performance  standard  and  evaluation  tools  which 
can  be  used  to  observe  the  tradeoffs  among  various  parameters.  In 
addition,  few  investigators  consider  the  communication  and  the 
design  of  the  interconnection  network  as  a  whole  and  the  influence 
of  communication  protocols  which  should,  nevertheless,  be  implemented 
for  the  intercommunication  function  of  the  interconnection  network 
is  usually  neglected.  Besides  these  problems,  the  fault  diagnosis 
scheme  for  the  interconnection  networks,  which  is  important  for  a 
reliable  or  fault  tolerant  system,  has  not  been  developed  and  the 
multiple-pass  realization  of  an  interconnection  network  and  related 
routing  algorithms  have  only  been  discussed  for  a  single-stage 
network.  The  problem  concerning  the  LSI  implementation  of  the  inter¬ 
connection  networks  also  remains  unanswered. 
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Chapter  2  surveys  the  multiple-processor  intercommunications. 
Firstly,  we  review  the  interconnection  organizations  of  multiple- 
processor  systems  to  emphasize  the  importance  of  multistage  inter¬ 
connection  networks  by  showing  the  limitations  of  interconnection 
organizations  such  as  time-shared/common  buses,  crossbar  switches 
and  multiport  memory  schemes.  Then  we  survey  particular  multistage 
interconnection  networks  which  were  proposed  from  significantly 
different  viewpoints.  Generally  speaking,  the  nonblocking  charac¬ 
teristic  of  the  interconnection  networks  is  not  the  prime  criterion 
for  choosing  network  structure.  Instead,  blocking  networks  with 
uniform  structure  are  always  found  in  practical  usage  and  proposed 
schemes.  Among  these  blocking  networks,  the  complexity,  the  number 
of  switching  elements  and  stages  do  not  differ  significantly 
between  approaches.  An  important  step  in  designing  an  interconnection 
network  is  to  choose  a  network  structure  which  can  facilitate  imple¬ 
menting  effective  communication  protocols.  In  the  latter  part  of 
Chapter  2,  we  catalogue  a  wide  variety  of  switching  concepts  and 
parameters  which  a  designer  may  have  to  encounter  in  planning  and 
designing  an  interconnection  network.  In  the  last  part  of  Chapter  2, 
we  provide  a  set  of  characteristics  of  interconnection  networks,  which 
can  be  used  to  specify  the  performance  standard,  and  describe  some 
hardware  and  software  requirements  for  implementing  functions  of 
interconnection  networks. 

A  baseline  network  is  introduced  in  Chapter  3  to  evaluate 
the  relationships  among  the  multistage  interconnection  networks 
which  have  been  proposed  from  significantly  different  viewpoints. 

It  is  shown  that  a  class  of  topologically  equivalent  multistages 
interconnection  networks  can  be  obtained  by  properly  permuting  the 
switching  elements  and  associated  links  of  the  baseline  network 
within  the  same  stage.  The  class  of  topologically  equivalent  multi¬ 
stages  interconnection  networks  includes  the  indirect  binary  n-cube 
network,  the  modified  data  manipulator,  the  flip  network,  the  omega 
network,  the  regular  SW  banyan  network  with  S=F=2,  the  reverse 
baseline  network,  and  the  baseline  network.  A  logical  name  repre¬ 
sentation  scheme  is  developed  to  configure  this  class  of  the 
topologically  equivalent  networks.  It  is  shown  that  one 
network  in  this  class  can  share  the  same  routing  information 


195 


f 


1 


developed  for  another  network  in  this  same  class  if  these  two  networks 
use  the  same  representation  scheme. 

The  logical  name  representation  scheme  enables  a  simple  routing 
algorithm  and  the  routing  algorithms  are  proven  to  be  complete  and 
homogeneous  so  that  no  distinction  should  be  made  between  the  inputs 
and  the  outputs.  A  routing  procedure  is  developed  on  the 
basis  of  the  homogeneous  routing  algorithm.  Since  all  the  networks 
in  the  defined  class  are  blocking,  the  routing  procedure  includes 
the  capability  to  resolve  the  conflicts  by  choosing  a  deferred  set 
of  mapping  requests  according  to  some  priority  scheme.  The  routing 
procedure  can  also  be  extended  to  allow  any  connections 
between  all  pairs  of  terminals  so  that  there  is  no  need  to  divide 
the  terminals  into  two  disjoint  sets. 

The  logic  name  representation  scheme  provides  a  formal  addressing 
for  the  components  of  the  interconnection  networks.  Using  this 
addressing  sheme,  we  can  then  identify  the  design  issues  for  the 
fault-diagnosis  scheme,  the  logic  partitioning,  and  the  packet  switch¬ 
ing  communication.  The  homogeneous  routing  procedure  and  the  full 
communication  already  provide  a  routing  protocol  for  the  packet 
switching  communication. 

In  Chapter  4  we  present  a  fault  model  for  the  network 
in  the  class  of  multistage  interconnection  networks.  Fault  diagnosis 
procedures  for  the  network  constructed  of  switching  elements  with 
two  valid  states  have  been  considered.  A  diagnosis  method  for  single 
faults  and  a  detection  method  for  multiple  faults  are  developed.  In 
the  diagnosis  procedures  the  control  lines  of  the  switching  elements 
in  the  same  stage  can  be  grouped  together  and  activated  by  the  same 
control  signal.  The  control  line  grouping  of  each  stage  is  exactly 
the  control  scheme  used  in  the  flip  network  of  STARAN.  Hence,  the 
diagnosis  procedures  developed  in  this  paper  are  good  both  for  the 
indirect  binary  n-cube  network  and  the  flip  network.  Extension  to 
the  network  constructed  of  switching  elements  with  four  valid  states 
is  feasible  since  the  test  sets  of  faults  in  switching  elements  with 
four  valid  states  are  the  same  as  those  we  developed  for  switching 
elements  with  two  valid  states.  The  problem  left  is  to  design 
diagnosis  procedures  with  minimal  or  nearly  minimal  number  of  tests. 
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The  number  of  tests  which  is  required  under  various  conditions 
in  the  diagnosis  procedures  developed  in  Chapter  4  is  summarized 
as  follows.  The  number  of  tests  for  detecting  single  faults  is 
equal  to  four  and  is  independent  of  the  network  size.  The  number 
of  tests  for  detecting  multiple  faults  is  equal  to  2(l+log2N),  where 
N  is  the  number  of  terminal  links  in  one  side  of  the  network.  The 
number  of  tests  needed  for  determining  the  fault  location  and  the 
fault  type  of  a  single  fault  depends  on  the  fault  type  and/or  the 
size  of  the  network.  The  minimum  number  of  tests  needed  for  deter¬ 
mining  the  fault  location  and  the  fault  type  is  equal  to  four  and 
the  maximum  max  (12 ,6+2  [”log(logN)|  ) .  For  a  network  of  size  N  *  1024 
the  maximum  is  equal  to  14.  There  exist  four  switching  element 
faults  (Subcase  F)  which  cannot  be  pinpointed  at  the  single  switching 
element  level  and  those  four  are  not  distinguishable  from  the  link 
stuck  fault.  This  study  provides  specific  information  of  fault 
characteristics  for  designing  an  easily  diagnosable  network,  or  a 
fault  tolerant  network. 

A  reverse-exchange  interconnection  network  that  is  shown  to 
be  a  powerful  interconnection  network  for  the  parallel  processing 
system  is  introduced  in  Chapter  5.  The  homogeneous  routing 
procedure  can  be  used  to  control  the  network  for  general  permutations 
We  have  also  provided  a  set  of  theorems  to  specify  the  realizable 
permutations  which  are  useful  to  the  parallel  processing.  The 
realizable  permutations  are  then  classified  into  four  groups  and 
a  recursive  formula  is  derived  to  calculate  the  control  pattern  of 
the  network  for  each  permutation  group.  The  recursive  formulas  can 
provide  superior  operating  speed  over  the  existing  routing  algorithms 

It  is  proven  that  all  permutations  can  be  realized  by  the 
reverse-exchange  network  in  two  passes.  Both  the  construction  and 
the  routing  algorithm  are  provided.  Our  result  compares  favorably 
with  0(/N)  or  0(JW  log^N)  steps  needed  in  other  networks.  The 
network  is  also  shown  to  be  useful  for  the  bit-reverse  permutation, 
the  multi-dimensional  access  memory  and  partitioning  the  array 
computer. 

The  needs  of  having  a  cost  effective  LSI  implementation  of 
interconnection  networks  are  obvious.  Among  the  needs  are  to  extend 


the  switch  design  from  size  2  »  2  to  size  2°  *  2°,  to  improve  the 

reliability  of  switching  elements,  and  to  expose  problems  in  LSI 

implementation  of  interconnection  networks.  However,  there  is 

little  activity  concerning  these  needs.  In  Chapter  6,  we  have 

shown  a  logic  partitioning  scheme  which  can  be  used  to  implement  the 

class  of  multistage  interconnection  networks  optimally  in  the  sense 

of  using  LSI  circuit  ships  of  one  modular  type  and  resulting  in  the 

minimum  pin-to-switching  element  ratio.  The  scheme  can  be  divided  into 

four  major  parts.  The  first  part  shows  how  to  partition  the  network 

and  results  in  a  general  partition  formula.  In  the  second  part  the 

general  partition  formula  is  manipulated  to  minimize  the  number  of 

modular  types.  As  shown  in  Chapter  6,  if  the  maximum  size  of  the 

network  which  can  be  implemented  in  an  LSI  circuit  chip  is  equal  to 

2am,  we  can  always  implement  the  baseline  network  of  size  2°,  n  -  a^, 

using  circuit  chips  of  one  type,  each  of  which  contains  a  baseline 

network  of  size  2a  where  (a  )/2  <  a  *  a  .  In  the  third  part  we  count 

m  m 

the  total  pins  needed  in  an  implementation  partitioning.  The  last 
part  tackles  the  problem  of  interconnecting  circuit  chips  to  fulfill 
the  topology  describing  rules  which  define  the  network  structure. 

A  formula  has  been  developed  to  identify  switching  elements  in  each 
circuit  chip. 

In  summary,  we  first  describe  general  design  philosophy  of  the 
interconnection  networks  and  then  define  a  class  of  multistage  inter¬ 
connection  networks.  For  the  class  of  multistage  interconnection 
networks,  we  develop  the  routing  algorithms,  the  fault-diagnosis 
scheme,  the  reverse-exchange  permutation  groups,  and  the  two-pass  reali¬ 
zation  of  all  permutations , and  the  logic  partitioning  for  LSI  implementation. 

Several  possible  extensions  which  are  closely  related  to  this 
study  appear  to  be: 

(1)  Implement  packet  switching  in  the  class  of  multistage 
interconnection  networks  by  using  the  homogeneous  routing 
procedure. 

(2)  Extend  the  binary  tree  coding  method  to  general  inter¬ 
connection  networks. 

(3)  Use  associative  memory  techniques  to  implement  the  routing 
procedure  and  the  conflict  resolution  scheme. 
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(4)  Design  an  easily  testable  switching  element  using  the 
fault  characteristics  developed. 

(5)  Re-evaluate  the  fault-diagnosis  scheme  to  locate  fault 
at  circuit  module  level. 

(6)  Extend  the  fault-diagnosis  scheme  to  the  networks  with 
broadcasting  capability  such  as  the  omega  network,  and 
to  general  networks  such  as  Benes  binary  networks  and 
crossbar  networks. 

(7)  Investigate  the  possibility  of  using  the  reverse-exchange 
interconnection  network  for  the  dynamic  memory  access  and 
block  data  access. 

(8)  Quantitatively  compare  the  reverse-exchange  network  to 
the  other  networks  such  as  the  shuffle-exchange  network 
and  the  flip  network. 

(9)  Systematically  partition  the  network  control  structure 
along  with  the  network  body  for  LSI  implementation. 
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A  MICROPROCESSOR-CONTROLLED 
ASYNCHRONOUS  CIRCUIT  SWITCHING  NETWORK 


Abstract 

This  appendix  describes  an  asynchronous  circuit  switching  net¬ 
work  for  multiple-processor  systems.  Several  circuit  switching 
networks  for  various  applications  have  been  proposed  and  constructed. 
However,  typical  problems  associated  with  these  networks  include 
that  of  the  synchronous  switching,  the  central  control,  the  graceful 
degradation,  the  flood  routing,  the  limited  connectivity,  and  the 
cost  effective  LSI  implementation  and  software  development.  The 
asynchronous  circuit  switching  network  possesses  several  features  that 
can  solve  such  problems.  A  three-stage  fully  connected  topology  is 
utilized  to  construct  the  network.  Each  switching  element  of  the 
selected  topology  is  functionally  and  physically  identical  and  this 
facilitates  a  cost  effective  LSI  implementation  and  software  develop¬ 
ment.  The  control  structure  of  the  switching  element  and  the  routing 
algorithm  are  re-organized  to  fit  the  asynchronous  operation.  The 
network  takes  advantage  of  low-cost  microcomputers  to  do  the  distrib¬ 
uted  routing  control  and  to  implement  the  communication  protocols. 

The  graceful  degradation  characteristic  in  the  network  is  provided 
by  independent  multiple  paths  existing  between  any  pair  of  the  source 
and  the  destination.  A  network  monitor  is  incorporated  to  facilitate 
an  adaptive  routing  strategy  and  to  have  the  fault  disgnostic  capa¬ 
bility.  Three  alternatives  for  the  switching  element  implementation 
are  described  to  demonstrate  the  hardware  and  software  trade-offs. 

The  network  architecture  seems  to  facilitate  a  substantially  high 
throughput  intercommunication  system  for  the  tightly  coupled  distrib¬ 
uted  processing.  The  response  time  characteristic  under  various 
conditions  is  still  to  be  verified  by  simulation  studies. 


A.  1  Introduction 


The  interconnection  organization  of  processors  is  a  key  to  the 
classification  of  computer  systems.  Various  attributes  of  inter¬ 
connection  organizations  such  as  the  transfer  strategy,  the  control 
method,  the  path  structure,  and  the  system  topology  are  used  to 
classify  the  actual  system  designs  [14].  The  multiprocessor  systems 
are  also  classified  into  three  categories  of  interconnection  organi¬ 
zations:  time-shared/common-bus  systems,  crossbar  sw'tch  systems 

and  the  multiport  memory  systems  [13].  Basically  these  characteri¬ 
zations  are  derived  from  the  existing  systems.  However  recent 
advances  in  LSI  technology  have  caused  a  significant  change  in  the 
field  of  computer  architecture.  One  trend  is  to  use  a  plurality  of 
homogeneous  or  heterogeneous  processors  interconnected  together  to 
gain  operating  power  through  parallelism  and  improve  system  relia¬ 
bility  through  redundancy.  Based  on  this  trend,  various  multiple- 
processor  systems  such  as  associative,  parallel,  pipeline,  and 
multiprocessors  are  proposed  and  constructed  [1].  The  number  of 
homogeneous  or  heterogeneous  processors  in  the  multiple-processor 
system  will  keep  increasing  due  to  several  reasons.  First,  the 
processing  speed  in  the  future  can  be  significantly  increased  only 
by  increasing  the  degree  of  the  concurrent  processing.  Furthermore, 
the  low  cost  of  LSI  modules  allows  the  use  of  a  large  number  of 
processing  elements.  Thirdly,  there  are  certain  classes  of  problems, 
such  as  large  data  base  management,  weather  computations,  etc., 
which  are  beyond  the  capabilities  of  the  current  large  computers. 
However  when  the  number  of  processors  in  the  multiple-processor 
system  increases  to  a  certain  level,  say  the  order  of  100,  the  choice 
of  interconnection  organizations  becomes  a  critical  problem.  People 
are  even  considering  implementing  a  multiple-processor  system  by 
interconnecting  as  many  as  10^  processing  units.  System  performance 
and  practical  feasibility  of  such  a  multiple-processor  system  would 
be  terribly  limited  if  the  conventional  interconnection  technique  is 
used.  Thus  one  of  the  exciting  challenges  in  the  field  of  computer 
architecture  is  to  design  an  efficient  and  practical  intercommuni¬ 
cation  subsystem  for  multiple-processor  systems. 

Several  new  interconnection  organizations  have  appeared  in  the 


literature.  These  include  the  flip  network  in  the  STARAN  [19],  the 
indirect  binary  n-cube  network  for  a  microprocessor  array  [45],  a 
three-stage  interconnection  network  for  a  communication  processor 
proposed  by  North  Electric  Company  [76],  and  a  distributed  data 
network  for  distributed  processings  [77].  Even  in  these  new  inter¬ 
connection  organizations  there  exist  some  crucial  problems.  In  the 
flip  network,  the  simple  control  structure  allows  only  a  few  syn¬ 
chronous  permutations.  This  shortcoming  is  overcome  by  the  indirect 
binary  n-cube  network  using  individual  control  structure  for  each 
switching  element.  However,  the  central  control  strategy  of  the 
indirect  binary  n-cube  becomes  practically  unfeasible  when  the 
number  of  processors  is  very  large.  Also,  the  flip  network  and 
the  indirect  binary  n-cube  network  do  not  have  the  graceful  degra¬ 
dation  property  as  only  one  path  exists  between  the  source  and  the 
destination  processors.  The  interconnection  organization  proposed 
by  North  Electric  Company  can  provide  multiple  paths  between  source 
and  destination.  However,  its  flood  routing  scheme  severely  limits 
the  availability  of  the  components  in  the  network  and  hence  may 
cause  significant  response  delay.  The  distributed  data  network  using 
24  links  between  sources  and  destinations  allows  simultaneous  commu¬ 
nication  between  24  pairs  of  CPU's  while  the  other  207  CPU's  could 
possibly  wait  for  their  turn  to  transmit  data.  A  full-connection 
network  could  better  solve  this  bottleneck. 

Beyond  these  interconnection  problems  of  synchronous  switching, 
central  control,  graceful  degradation,  routing  techniques,  and  full 
connection,  we  have  to  consider  the  cost  effective  LSI  implementation 
of  the  interconnection  organization.  For  a  cost  effective  LSI  imple¬ 
mentation,  the  minimization  of  the  number  of  modular  types  is  of 
prime  importance  and  not  the  number  of  components  utilized.  Hence, 
it  would  be  a  good  criterion  to  partition  the  interconnection  organi¬ 
zation  into  functionally  and  physically  equivalent  modules  so  that 
LSI  implementation  and  software  control  programs  developed  for  a 
single  module  can  be  used  in  all  equivalent  modules.  On  the  other 
hand,  according  to  the  past  progress  in  LSI  technology,  we  may 
project  that  the  most  complex  computer  system  of  today  can  be 
fabricated  on  a  small  number  of  chips  within  the  next  few  years  [12]. 
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Being  moderate  we  can  predict  that  it  is  feasible  to  fabricate  a 
processor-memory-switch  (PMS)  group  on  a  single  chip  which  has 
several  communication  ports  for  the  intercommunication  purpose. 

The  objective  of  this  study  is  to  investigate  the  intercon¬ 
nection  problems  by  using  some  multistage  interconnection  networks 
upon  which  the  multiple-processor  system  can  be  modelled  as  shown 
in  Fig.  A.l.  Here,  the  PMS  box  could  represent  any  combination  of 
processor,  memory  and  switch,  and  IP  is  the  interface  processor. 
Section  A. 2  describes  the  configuration  of  an  asynchronous  circuit 
switching  interconnection  network  which  will  be  used  to  demonstrate 
the  solutions  to  the  interconnection  problems.  Section  A. 3  illus¬ 
trates  the  general  hardware  structure.  In  Section  A. A,  we  demon¬ 
strate  the  software  control  for  the  intercommunication  with  much 
emphasis  given  on  the  routing  techniques.  Finally  Section  A.  5 
discussed  some  system  characteristics. 

A. 2  Network  Configuration 

The  topology  and  the  label  of  the  component  (stage,  element, 
link)  of  the  selected  network  are  shown  in  Fig.  A. 2.  The  topology 
can  be  described  by  the  definition  of  (N,  N,  N)  Clos  rearrangeable 
network  [26],  or  series-parallel  network  [31].  The  choice  of  the 
three-stage  network  is  obvious.  The  full  accessable  single  stage 
crossbar  network  has  the  disadvantages  that  there  is  only  one  path 
between  a  source-destination  pair  and  the  cost  of  the  circuitry 
required  for  the  switching  facilities  becomes  significantly  high  when 
the  number  of  network  ports  becomes  large.  There  is  only  one  path 
between  a  source-destination  pair  in  the  two-stage  network  and  hence 
the  graceful  degradation  is  poor. 

The  stages  are  named  by  two-bit  binary  code  words,  00,  01,  and 
10  from  left  to  right.  The  left  stage  is  connected  to  the  active 
side  and  the  right  stage  is  connected  to  the  passive  side.  The 
connection  request  can  only  be  initiated  on  the  active  side.  Assume 
N  is  a  power  of  2.  The  N  x  N  switching  element  in  each  stage  is 
named  by  £  =  log^N  binary  bits  PjP^  ]/’*Pi  which  are  the  binary 
representation  of  its  location  in  the  stage.  Each  interstage  link 
is  named  by  2i  binary-bit  code  words  P2£P2Jt-l’ ’ ’^1’  w^ic^  is  c°ded 
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according  to  the  following  scheme:  The  i  leftmost  bits,  p9„p  ••• 
p^+^ ,  are  the  same  as  the  binary  representation  of  the  N  x  N  switching 
element  to  which  the  link  is  connected  on  one  of  its  terminals  on  the 
right  side.  The  last  1  bits,  p^p^  ^  .  . . p^  ,  identify  the  location  of 
the  link  out  of  the  N  links  connected  to  the  N  x  N  switching  element. 

Hie  link  on  two  sides  of  the  network  is  also  named  by  a  21  binary-bit 

code  word  which  is  the  binary  representation  of  its  location,  and  is 
used  as  the  address  of  the  interface  processor  attached  to  that  link. 
For  easy  recognition  the  names  are  shown  in  decimal  numbers  in 
Fig.  A. 2. 

There  is  a  uniform  structure  in  the  selected  topology.  Each 

N  x  N  switching  element  is  identical  and  there  are  N  possible  paths 

between  any  two  terminals  at  opposite  sides.  Various  types  of  non- 
blocking  or  rearrangeable  subtopology  can  be  configured  in  the 
selected  topology. 

A. 3  Hardware  Structure 

The  explicit  hardware  requirement  in  a  connection  path  is  shown 
in  Fig.  A. 3.  The  network  interface  to  the  PMS'  is  provided  by  an 
interface  processor  (IP).  The  IP  of  the  source  PMS  is  connected 
to  an  N  x  N  switching  element  in  the  left  stage.  As  illustrated  in 
Fig.  A. 2,  the  N  x  N  switching  element  in  the  left  stage  is  connected 
to  each  N  x  N  switching  element  in  the  center  stage.  The  connection 
path  is  switched  to  one  of  the  N  x  N  switching  elements  in  the  center 
stage  and  then  is  switched  to  an  N  x  N  switching  element  in  the  right 
stage  which  is  then  connected  to  the  destination  PMS  via  its  IP. 

Since  the  N  x  N  switching  elements  in  each  of  the  three  stages  are 
functionally  and  physically  equivalent  we  can  design  just  one  kind 
of  N  x  N  switching  element  and  use  it  in  all  stages.  Another  impor¬ 
tant  part  is  the  network  monitor.  A  general  description  of  the  IP, 
the  N  x  N  switching  element  and  the  network  monitor  is  provided  as 
follows. 


The  IP  implements  a  communication  protocol  between  the  PMS 
and  the  network.  Examples  of  microprocessor  implementation  of 
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the  communication  protocol  are  the  CC1TT  recommended  X.25 
protocol  [78]  and  the  Advanced  Data  Communication  Control 
Procedure  (ADCCP)  [77].  The  functional  block  diagram  of  the 
IP  shown  in  Fig.  A. 4  is  actually  a  microcomputer  with  a  set  of 
special  hardware  logic  containing  input-output  buffering  logic, 
channel  line  interface  logic,  protocol  logic,  and  interface  for 
the  DMA  and  I/O  port  of  the  PMS . 

The  microprocessor  along  with  its  software  and  firmware 
controls  the  DMA  input  and  output  transfer  between  the  PMS  and 
the  IP  and  the  interface  logic  (input  control  and  output  con¬ 
trol).  The  program  controlled  I/O  can  also  be  used  for  the 
communication  between  the  PMS  and  the  microprocessor. 

At  the  receiving  channel  line,  data  is  received  serially 
from  the  network  and  the  protocol  logic  performs  sequence 
detection,  error  detection,  frame  length  count,  loads  the  data 
into  an  input  buffer,  and/or  initializes  a  DMA  transfer  via 
the  input  control  logic.  At  the  transmitting  channel  line, 
data  is  transferred  from  the  PMS  memory  via  DMA  to  an  output 
buffer,  and  the  protocol  logic  sends  a  request  to  gain  access 
to  the  network,  and  after  having  received  a  permission  message 
from  the  receiving  channel  line  transmits  the  data  serially  over 
the  link. 

B.  N  x  N  switching  element 

The  N  x  N  switching  element  contains  a  microprocessor  with 
ROM  and  RAM,  a  scanner,  a  forward  data  plane,  and  a  backward 
data  plane  as  shown  in  Fig.  A. 5.  The  microprocessor  and  the 
scanner  form  the  controller  of  the  switching  element.  The 
forward  and  the  backward  data  planes  form  the  transfer  unit 
that  receives  control  signals  from  the  controller  and  provides 
the  bidirectional  circuit  switching. 

The  scanner  detects  the  status  of  the  N  links  and  sends 
the  output  to  the  microprocessor.  There  is  a  similarity  between 
the  scanner  and  that  for  the  telephone  switching  [79,80]  in  the 
functional  point  of  view.  However,  more  functions  are  expected 
from  the  scanner  here.  The  scanner  sequentially  polls  the  status 
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Fig.  A. 4  Functional  block  diagram  of  interface  processor  (IP). 
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Fig.  A. 5  Block  diagram  of  an  NxN  switching  element. 
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of  the  input  lines  of  the  forward  data  plane.  Upon  detecting 
a  connection  in  the  protocol  conversion  logic  of  the  scanner, 
the  polling  address  and  the  extracted  destination  address  are 
passed  to  the  microprocessor.  If  an  open  signal  is  detected, 
the  polling  address  is  passed  to  the  microprocessor  for  dis¬ 
connecting  the  path. 

The  microprocessor  receives  the  connection  address  and  the 
disconnection  address  from  the  scanner  and  transforms  these 
messages  into  control  signals  which  are  sent  to  the  data  planes 
for  establishing  the  path  or  disconnecting  the  path.  If  there 
is  a  path  conflict  existing  in  the  data  plane  for  adding  a  new 
path,  the  control  signals  are  then  ignored.  The  routing  pro¬ 
cedure  which  is  built  in  RAM  not  only  generates  the  control 
signals  but  also  monitors  the  routing  statistics  which  are  then 
sent  to  the  network  monitor  for  updating  the  routing  table  and 
for  diagnostic  purposes. 

There  are  several  N  x  N  interconnection  networks  which  can 
be  used  to  implement  the  circuit  switching  required  in  the  for- 
ward  data  plane  or  in  the  backward  data  plane.  We  will  consider 
three  kinds  of  interconnection  networks:  the  versatile  line 
manipulator  [39],  the  class  of  multistage  interconnection  net¬ 
works,  and  the  Benes  binary  network  [26].  An  N  x  N  versatile 
line  manipulator  (VLM)  is  shown  in  Fig.  2.19.  The  jth  input  is 
connected  to  the  ith  output  if  the  cell  (i,j)  is  activated. 

The  ith  address  control  register  determines  the  location  of  the 
cell  in  the  ith  row  to  be  activated.  The  VLM  can  also  provide 
the  capability  of  one-to-many  connections.  The  configurations 
of  the  class  of  multistage  interconnection  networks  have  been 
described  in  Chapter  3.  The  Benes  network  can  be  obtained  by 
overlapping  the  rightmost  stage  of  the  baseline  network  and 
the  leftmost  stage  of  the  reverse  baseline  network  as  described 
in  Chapter  5.  In  addition  to  the  interconnection  network  body, 
a  set  of  register  array  for  controlling  the  2x2  switching 
element  and  a  decoder  for  distributing  control  signals  to  the 
proper  register  array  ,  as  shown  in  Fig.  2.19  for  the  versatile 
line  manipulator,  should  be  incorporated  into  each  data  plane. 
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C.  Network  monitor 

The  network  monitor  functions  as  a  statistic  analyzer  and 
a  diagnostic  unit.  It  is  connected  to  the  network  in  the  same 
way  as  the  PMS'  are  connected.  Hence  it  can  receive  messages 
from  each  PMS  and  also  can  transfer  messages  to  each  PMS.  The 
network  monitor  can  also  directly  access  each  N  x  N  switching 
element  to  collect  traffic  statistics  and  update  routing  tables 

A. 4  Software  Control 

This  section  discusses  the  communication  protocols,  routing 
techniques,  reliability,  and  the  overall  operation  of  the  network. 


A.  Communication  protocols 

The  two-level  communication  protocols  of  circuit  switching 
data  networks  recommended  by  several  standard  organizations  such 
as  ANSI  and  CC1TT  [78]  have  been  utilized  here.  Level  1  concerns 
the  physical  and  electrical  characteristics  to  establish,  main¬ 
tain,  and  disconnect  the  physical  link  between  devices  and  Level 
2  describes  the  point-to-point  link  control  for  the  exchange 
data  between  two  devices.  As  shown  in  Fig.  A. 3,  each  block 
represents  a  device  point  in  a  path.  The  point-to-point  commu¬ 
nication  occurs  between  the  following  points:  from  source  PMS 
to  source  IP,  from  source  IP  to  each  N  x  N  switching  element, 
from  source  IP  to  destination  IP  and  from  destination  IP  to 
destination  PMS.  The  communication  protocols  are  implemented 
in  the  IP  and  the  scanner  hardware  as  described  in  Section  A. 3  . 
The  data  and  the  supervisory  information  are  packed  into  the 
hardware  generated  frame.  The  flow  and  error  control  are  also 
included  in  Level  2  protocol. 

B.  Routing  techniques 

The  routing  problem  can  be  considered  from  two  levels: 
global  level  and  local  level.  The  global  level  considers  the 
interpoint  routing  problem  and  the  local  level  concerns  the 
routing  problem  inside  the  N  x  N  switching  element. 
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]/,,z£+i  in  C^e  ri8ht  stage  then  detects  the 
request  from  source  IP  and  extracts  the  destination 
address.  Switching  element  lO-z^j^^  i**'z£+i 
establishes  a  path  between  input  t^t^  ^...t^  on  the  left 
side  and  output  z^z^  ^...z^  on  the  right  side.  This 
completes  a  bidirectional  path  between  source  PMS '  IP 
and  destination  PMS'  IP.  Since  there  are  alternative 
paths  for  a  connection  request,  an  optimal  routing  problem 
naturally  arises.  An  adaptive  routing  method  can  be  used 
by  implementing  a  dynamic  routing  table  which  is  optimally 
updated  by  the  network  monitor. 


2.  Local  level: 

The  local  level  routing  of  three  kinds  of  intercon¬ 
nection  networks  as  described  in  Section  A.3.B  will  be 
investigated  here. 

a.  Versatile  line  manipulator:  The  versatile  line 
manipulator  requires  little  logical  complexity  for  the 
local  routing.  To  connect  a  path,  the  controller  of  the 
N  x  N  switching  element  checks  into  its  working  file  for 
the  availability  of  the  addressed  link  on  the  destination 
side.  If  the  link  on  the  destination  side  is  free,  the 
controller  sends  the  address  of  the  two  addressed  terminal 
links,  j  and  i,  to  the  forward  and  backward  data  planes 

to  update  the  IMR  and  OMR  and  to  activate  cell  (i,j).  To 
remove  a  path,  the  controller  restores  the  mask  bit  in 
IMR  and  OMR,  and  the  availability  of  the  link  on  the 
destination  side  in  its  working  file. 

b.  A  class  of  multistage  interconnection  networks:  A 
homogeneous  routing  procedure,  names  binary  tree  coding 
method,  has  been  developed  for  the  class  of  multistage 
interconnection  networks  in  Chapter  3.  How  to  control  the 
2x2  switching  element  for  the  asynchronous  operation  has 
been  discussed  in  Chapter  6.  See  Fig.  6.5  for  the  grouping 
of  the  valid  states  and  Eqs.  (6.14)  and  (6.15)  for  the 
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setting  of  the  control  bit.  A  status  table  of  switching 
elements  is  constructed  for  the  routing  procedure.  An 
example  is  shown  in  Table  A. 1.  The  routing  problem  is 
defined  as  follows.  Suppose  we  have  existing  connections 
in  the  N  x  N  switching  elements  and  the  status  table  is 
given  as  the  example  shown  in  part  (a)  of  Table  A.l,  we 
want  to  add  a  new  connection  or  to  remove  an  existing 
connection.  Part  (a)  of  Table  A.l  is  used  to  show  the 
status. of  an  8  x  8  baseline  network  which  contains  the 
connection  between  terminal  0  on  Side  1  and  terminal  4 
on  Side  2.  Each  column  of  the  table  corresponds  to  a 
stage.  The  upper  row  of  the  entry  in  the  table  is  the 
status  information  of  the  2x2  switching  element  specified 
in  the  lower  row.  The  leftmost  bit  of  the  status  infor¬ 
mation  is  the  control  bit  and  the  other  two  bits  are  used 
to  specify  the  number  of  users.  Assume  terminal  2  on 
Side  1  requests  connection  to  terminal  7  on  Side  2. 

According  to  Eq.  (6.14)  the  in-path  switching  elements 
are  (01)q,  (10)^  and  (ll^.  The  related  control  bits  are 
0,  0  and  1  according  to  Eq.  (6.15).  First  we  check  if 
conflicts  exist  between  the  existing  connections  and  the 
one  to  be  added  by  applying  a  bit-by-bit  EXCLUSIVE  OR 
operation  between  the  status  information  of  each  in-path 
switching  element  and  the  code  word  formed  by  concatenating 
the  calculated  control  bit  and  00.  If  no  result  of  the 
operation  is  greater  than  100,  there  is  no  conflict  and  we 
can  proceed  to  update  the  status  table.  Otherwise,  the 
request  should  be  deferred.  The  control  signal  should  be 
sent  to  the  switching  element  if  the  result  of  the  EXCLUSIVE 
OR  operation  for  that  switching  element  is  equal  to  100. 
There  is  no  conflict  in  our  example  so  that  we  proceed  to 
update  the  status  information.  The  contents  of  entries 
(01)Q  and  (ID2  should  be  changed  from  000  to  001  and  101, 
respectively,  and  the  contents  of  entry  (10)^,  should  be 
changed  from  001  to  010  since  there  are  two  users  using 
(10)^.  The  updated  table  is  shown  in  part  (b)  of  Table  I. 


A  control  signal  1  should  be  sent  to  (11)  .  The  removal 
of  a  connection  can  be  done  by  decreasing  the  number  shown 
in  the  user  field  of  the  status  information  by  1. 

c.  Benes  network:  Some  routing  algorithms  [29,73,74] 
have  been  developed  to  perform  permutations  on  the  Benes 
network.  These  routing  algorithms  are  not  suitable  for 
the  asynchronous  operation.  A  new  routing  algorithm  for 
the  asynchronous  operation  is  developed  here.  Using  the 
routing  procedure  developed  for  the  class  of  multistage 
interconnection  networks  in  Chapter  3,  we  obtain  the 
following  properties: 

(1)  There  are  N/2  possible  paths  connecting  two 
terminal  links  at  the  opposite  sides  of  the 
N  x  N  Benes  network. 

(2)  Each  of  the  N/2  possible  paths  passes  through 
different  2x2  switching  element  in  the  center 
state. 

(3)  Let  A  =  a^a^^.-.a^  on  the  left  side  be  connected 

to  Z  =  zizi  i’*'zi  on  c^e  side  anci  t*le  two 

valid  states  described  for  the  class  of  multi¬ 
stage  interconnection  networks  above  also  be 
used  for  the  Benes  network.  The  control  bit  of 
the  in-path  switching  element  in  the  center  stage 
is  equal  to  a^  @  z^. 

An  example  of  an  8  *  8  Benes  network  is  shown  in  Fig.  A. 7. 
The  source  terminal  A  =  Oil  is  connected  to  destination 
terminal  Z  =  101  via  N/2  (N=8)  paths.  Each  path  passes 
through  different  2x2  switching  element  in  the  center 
stage  and  the  control  bit  of  each  switching  element  should 
be  equal  to  a^  ©  *2  ■  1.  According  to  the  above  proper¬ 
ties  and  the  status  table  developed  as  shown  in  Table  A.l, 
we  have  a  simple  routing  algorithm  for  the  asynchronous 
operation : 

Step  1:  Calculate  the  control  bit  of  the  in-path  switching 
element  in  the  center  stage  using  a^  ©  v 
Step  2:  Find  a  free  2x2  switching  element  in  the  center 
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stage  which  can  be  set  by  the  calculated  control 
bit . 

Step  3:  Assume  the  location  of  the  in-path  links  connected 
to  the  center  stage  are  L  and  R  in  the  left  and 
right  sides  of  the  2x2  switching  element  in  the 
center  stage,  respectively.  Calculate  the  routing 
information  using  A  and  R  as  the  source-destination 
pair  on  the  baseline  network  and  using  L  and  Z  as 
the  source-destination  pair  on  the  reverse  base¬ 
line  network. 

Step  4:  Do  the  routing  procedure  as  described  in  the 

example  shown  in  Table  A.l.  If  there  are  con¬ 
flicts  go  to  Step  2  to  try  another  path. 

C.  Reliability 

The  circuit  switching  network  can  provide  multiple  paths  between 
any  two  PMS'  while  connections  from  various  switching  elements  to 
multiports  of  PMS  enables  one  of  the  several  alternate  paths  to 
be  established.  The  failure  of  one  N  x  N  switching  element  does 
not  rule  out  the  connection  possibility  between  any  two  PMS'  and 
does  not  affect  the  function  of  other  N  x  N  switching  elements.  A 
failure  can  be  reported  to  the  network  monitor  by  PMS'  via  connec¬ 
tion  paths  or  by  the  controllers  of  N  x  N  switching  elements.  A 
failure  can  be  detected  by  PMS'  if  a  message  has  been  retransmitted 
several  times  without  a  response  or  with  a  negative  acknowledge 
from  the  destination.  An  invalid  sequence  can  also  be  detected 
by  an  N  x  N  switching  element  as  a  failure.  The  use  of  Cycle 
Redundancy  Code  (CRC)  allows  continuous  checking  of  the  data  and 
improves  the  reliability  of  the  system.  The  fault  diagnosis  can 
then  be  initiated  by  the  network  monitor.  A  redundant  standby 
network  monitor  can  be  used  to  take  over  the  monitoring  work  when¬ 
ever  the  operating  one  fails. 

D.  Overview  of  data  transmission 

All  transmissions  are  in  frames  which  sequentially  contain 
initial  flag  sequence,  destination  address  field,  control  field. 
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information  field,  frame  check  bit  sequence,  and  end  flag 
sequence.  Frame  types  include  request  to  send  (RS) ,  ready  to 
receive  (RR) ,  not  ready  to  receive  (NRR) ,  acknowledge  (ACK) , 
negative  acknowledge  (NACK) ,  and  data. 

The  PMS  selects  a  port  and  puts  outgoing  data  in  the  output 
buffer  of  the  IP  via  the  DMA  logic.  When  the  data  is  ready  for 
transmission,  the  IP  hardware  generates  an  RS  frame  and  transmits 
it  repeatedly  to  the  network  within  a  prescribed  time  interval. 

If  the  sending  (or  source)  IP  does  not  receive  a  response  from 
the  receiving  (or  destination)  IP  in  the  time  interval,  it 
retries  after  a  delay  period. 

The  scanner  of  the  N  x  N  switching  element  connected  to 
the  IP  recognizes  the  RS  and  sends  the  source  and  the  destination 
addresses  to  the  controller.  The  controller  then  selects  one 
N  x  N  switching  element  in  the  center  stage  for  connection, 
according  to  the  routing  table,  and  generates  the  control  signals 
to  connect  the  IP  to  that  N  x  N  switching  element  in  the  center 
stage  on  the  forward  data  plane  and  the  backward  data  plane.  The 
scanner  of  the  chosen  N  x  N  switching  element  in  the  center 
stage  can  now  receive  the  RS  frame.  The  destination  address 
is  extracted  and  the  controller  checks  the  availability  of  the 
link  connected  to  the  N  x  N  switching  element  (in  the  right 
stage)  which  is  connected  to  the  destination.  If  the  link  is 
occupied  the  address  extracted  is  just  ignored  and  the  link 
availability  is  rechecked  in  the  next  scanner  cycle.  If  the 
link  is  not  occupied  the  controller  generates  the  control 
signals  to  connect  the  path  from  the  N  x  N  switching  element 
in  the  left  stage  to  the  N  x  N  switching  element  in  the  right 
stage.  The  scanner  of  the  N  x  N  switching  element  in  the  right 
stage  can  then  receive  the  RS  frame  and  the  controller  of  that 
switching  element  can  complete  the  path  by  generating  and 
sending  control  signals  to  the  data  planes  to  connect  the  N  x  N 
switching  element  in  the  center  stage  to  the  receiving  IP. 

The  receiving  IP  is  interrupted  after  receiving  the  first 
RS  and  it  verifies  that  it  is  the  destination.  If  not,  the  RS 
frame  is  ignored  and  a  fault  is  reported.  If  the  receiving  IP 
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verifies  that  the  destination  is  itself,  it  sends  an  RR  or  NRR 
frame  (not  ready  to  receive).  If  the  NRR  is  returned  the 
sending  IP  terminates  the  transmission  and  retries  after  a  pre¬ 
scribed  time  interval.  If  the  RR  is  returned  the  sending  IP  is 
interrupted  and  it  initiates  transmission  of  the  data  frames. 

The  receiving  IP  acknowledges  a  valid  reception  with  an  ACK 
frame  and  then  initiates  a  DMA  request  to  transfer  the  data  in 
the  input  buffer  to  the  PMS ,  or  acknowledges  an  error  reception 
with  NACK  frame.  If  an  ACK  frame  is  returned  the  sending  IP  is 
interrupted  and  sends  an  open  signal.  The  scanner  of  each  N  x  N 
switching  element  in  the  path  recognizes  the  open  signal  and 
the  controllers  in  the  path  accordingly  disconnect  the  path. 

If  an  NACK  is  returned,  the  retransmission  is  initiated.  If 
the  receiving  IP  responds  to  the  NACK  frame  again,  the  sending 
IP  then  sends  open  signals  to  break  the  path.  After  initiating 
a  report  of  the  presence  of  the  retransmission  fault  the  PMS 
can  then  select  another  port  and  initiate  the  same  connection 
procedure  to  transmit  the  data. 

A. 5  Discussion  of  System  Characteristics 

The  network  contains  3N  N  x  N  switching  elements  and  hence 

requires  3N  microcomputers  for  the  distributed  routing  control.  The 

functionally  and  physically  equivalent  N  x  N  switching  elements  are 

good  for  the  cost  effective  LSI  implementation  and  the  software 

2 

development.  Since  the  number  of  ports  is  N  on  the  right  side  and 
2  2 

N  on  the  left  side,  2N  additional  microcomputers  are  required  for 
the  interface  processors  which  implement  the  communication  protocols 
at  the  interface  of  the  PMS  and  the  network. 

Independent  multiple  paths  between  any  two  PMS'  facilitate  the 
graceful  degradation  capability.  The  failure  of  an  N  x  N  switching 
element  does  not  affect  the  operation  of  other  N  x  N  switching  ele¬ 
ments.  The  dual  network  monitors  serve  the  diagnostic  functions. 

In  contrast  to  the  flood  routing  procedure,  the  routing  proce¬ 
dure  developed  here  allows  simultaneous  path  establishments  for 
connection  requests.  The  adaptive  routing  scheme  can  be  implemented 
to  achieve  the  optimal  routing. 


The  network  can  simultaneously  provide  N*"  full  duplex,  asynchro¬ 
nous,  bit  serial  circuit  switching  paths.  The  bit  serial  path  can 
be  extended  to  the  bit  parallel  path  by  adding  the  proper  number  of 
data  planes  in  each  N  x  N  switching  element  and  using  bit  parallel 
IPs.  The  throughput  of  each  path  is  dependent  on  the  transmission 
speed  of  the  interface  microcomputer  using  DMA  techniques.  The 

Fairchild  F464  CCD  memory  can  provide  a  transfer  rate  of  5  Mbit/sec. 

2 

Hence  the  maximum  network  throughput  can  be  as  high  as  5N  Mbit/sec. 
It  should  be  remembered  that  significantly  higher  speed  memory  and 
devices  can  be  expected  in  the  future. 

The  blocking  probability  of  establishing  a  path  and  the  average 
response  time  greatly  depends  on  the  size  and  amount  of  traffic,  the 
routing  strategy  and  the  hardware  structure  of  the  data  planes.  The 
traffic  model  is  different  from  case  to  case.  An  adaptive  routing 
method  can  be  utilized  to  achieve  optimal  routing.  We  have  illus¬ 
trated  three  different  hardware  alternatives  for  the  data  planes: 
the  versatile  line  manipulator,  the  class  of  multistage  interconnec¬ 
tion  networks  and  the  Benes  network.  Among  the  three  networks  the 
versatile  line  manipulator  requires  the  least  amount  of  complex 
software  with  the  maximum  amount  of  logic  circuits  (about  N/log2N 
times  that  of  the  class  of  multistage  interconnection  networks). 

The  class  of  multistage  interconnection  networks  provides  the 
highest  blocking  probability  and  requires  the  simplest  hardware 
configuration  while  almost  doubly  complex  hardware  and  software  is 
needed  for  the  Benes  network.  However,  the  Benes  network  can  provide 
N/2  alternative  paths  for  the  establishment  of  a  connection.  A 
detailed  simulation  study  is  required  to  observe  the  response  time 
characteristics  under  different  traffic  models,  routing  strategies 
and  data  plane  implementation. 
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